Apr 30 11:00:05 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:00:05 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:00:05 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:00:06 devstack cinder-volume[75506]: INFO dbcounter [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Registered counter for database cinder Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG oslo_db.sqlalchemy.engines [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG dbcounter [-] [75506] Writer thread running {{(pid=75506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:00:06 devstack cinder-volume[75506]: INFO cinder.rpc [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 11:00:06 devstack cinder-volume[75506]: INFO cinder.rpc [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG oslo_db.sqlalchemy.engines [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:00:06 devstack cinder-volume[75506]: INFO cinder.volume.manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Determined volume DB was empty at startup. Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG cinder.volume.manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75506) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 11:00:06 devstack cinder-volume[75506]: INFO cinder.volume.manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 30 11:00:06 devstack cinder-volume[75506]: WARNING stevedore.named [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 11:00:06 devstack cinder-volume[75506]: WARNING castellan.key_manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:00:06 devstack cinder-volume[75506]: WARNING cinder.keymgr.conf_key_mgr [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG cinder.volume.drivers.lvm [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75506) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 30 11:00:06 devstack cinder-volume[75506]: DEBUG oslo_concurrency.processutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_concurrency.processutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.379s {{(pid=75506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_db.sqlalchemy.engines [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:00:07 devstack cinder-volume[75506]: INFO cinder.rpc [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 30 11:00:07 devstack cinder-volume[75506]: INFO cinder.rpc [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 30 11:00:07 devstack cinder-volume[75506]: WARNING stevedore.named [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 11:00:07 devstack cinder-volume[75506]: WARNING castellan.key_manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:00:07 devstack cinder-volume[75506]: INFO cinder.volume.manager [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_db.sqlalchemy.engines [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:00:07 devstack cinder-volume[75506]: INFO oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Starting 1 workers Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Started child 75675 {{(pid=75506) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Full set of CONF: {{(pid=75506) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] ******************************************************************************** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Configuration options gathered from: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] ================================================================================ {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] allow_availability_zone_fallback = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] allow_compression_on_image_upload = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] allowed_direct_url_schemes = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] api_rate_limit = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] auth_strategy = keystone {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] az_cache_duration = 3600 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75675]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_availability_zone = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_host = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_stats_polling_interval = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backup_api_class = cinder.backup.api.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backup_name_template = backup-%s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backup_use_same_host = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backup_use_temp_snapshot = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] chap_password = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] chap_username = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_internal_tenant_project_id = 45ad17edd8bd403981fee8d5367e0aed {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_internal_tenant_user_id = 2b004444569f4f69a53cd90475090278 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cloned_volume_same_az = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cluster = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] compression_format = gzip {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] compute_api_class = cinder.compute.nova.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] config_dir = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] config_source = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] control_exchange = openstack {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] debug = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] default_availability_zone = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] default_group_type = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] default_volume_type = lvmdriver-1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] disk_geometry = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_client_cert = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_client_cert_key = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_data_namespace = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_ssl_cert_path = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_ssl_cert_verify = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] driver_use_ssl = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] enable_force_upload = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] enable_new_services = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] enable_unsupported_driver = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] enforce_multipath_for_image_xfer = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] filter_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_api_insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_api_servers = ['http://192.168.122.121/image'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_api_ssl_compression = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_ca_certificates_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_catalog_info = image:glance:publicURL {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_num_retries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance_request_timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] goodness_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] graceful_shutdown_timeout = 5 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] group_api_class = cinder.group.api.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] host = devstack {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_compress_on_upload = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_conversion_address_space_limit = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_conversion_cpu_limit = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_conversion_disable = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_upload_use_cinder_backend = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_upload_use_internal_tenant = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_volume_cache_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_volume_cache_max_count = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] image_volume_cache_max_size_gb = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] init_host_max_objects_retrieval = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] instance_format = [instance: %(uuid)s] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iscsi_target_flags = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iscsi_write_cache = on {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iser_helper = tgtadm {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iser_ip_address = 192.168.122.121 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iser_port = 3260 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_color = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_config_append = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_dir = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_options = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_rotate_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_rotate_interval_type = days {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] log_rotation_type = none {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] max_age = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] max_logfile_count = 30 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] max_logfile_size_mb = 200 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] max_over_subscription_ratio = 20.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] message_reap_interval = 86400 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] message_ttl = 2592000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] migration_create_volume_timeout_secs = 300 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] monkey_patch = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] monkey_patch_modules = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] my_ip = 192.168.122.121 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] no_snapshot_gb_quota = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] num_iser_scan_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] num_shell_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] num_volume_device_scan_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] nvmeof_conn_info_version = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] nvmet_ns_id = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] nvmet_port_id = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_max_limit = 1000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_ext_list = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_listen_port = 8776 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_use_ssl = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] osapi_volume_workers = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] per_volume_size_limit = -1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] periodic_fuzzy_delay = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] periodic_interval = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] public_endpoint = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] publish_errors = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_backup_gigabytes = 1000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_backups = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_gigabytes = 1000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_groups = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_snapshots = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] quota_volumes = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] rate_limit_burst = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] rate_limit_except_level = CRITICAL {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] rate_limit_interval = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] reinit_driver_count = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75675]: INFO cinder.volume.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] replication_device = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] report_discard_supported = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] report_interval = 120 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] reservation_clean_interval = 86400 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] reservation_expire = 86400 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] reserved_image_namespaces = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] reserved_percentage = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] rpc_response_timeout = 120 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] run_external_periodic_tasks = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] scst_target_driver = iscsi {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] scst_target_iqn_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_down_time = 720 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] shell_completion = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] snapshot_name_template = snapshot-%s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] snapshot_same_host = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] split_loggers = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] state_path = /opt/stack/data/cinder {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] storage_availability_zone = nova {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] storage_protocol = iSCSI {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] syslog_log_facility = LOG_USER {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_helper = lioadm {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_ip_address = 192.168.122.121 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_port = 3260 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack sudo[75683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_protocol = iscsi {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] target_secondary_ip_addresses = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] trace_flags = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] transport_url = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] until_refresh = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_chap_auth = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack sudo[75683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_default_quota_class = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_journal = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_json = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_multipath_for_image_xfer = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_stderr = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] use_syslog = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] verify_glance_signatures = enabled {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_api_class = cinder.volume.api.API {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_backend_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_clear = zero {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_clear_ionice = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_clear_size = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_copy_bps_limit = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_dd_blocksize = 1M {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_name_template = volume-%s {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_service_inithost_offload = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volume_usage_audit_period = month {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] zoning_mode = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_concurrency.disable_process_locking = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.admin_password = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.admin_token = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.admin_user = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_port = 35357 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_protocol = https {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_section = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_type = password {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_uri = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.auth_version = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.cache = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.identity_uri = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.include_service_catalog = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.interface = public {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_password = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcache_username = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.region_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.service_type = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.121/identity {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.backend = dogpile.cache.null {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.backend_argument = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.backend_expiration_time = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.config_prefix = cache.oslo {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.debug_cache_backend = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.enable_retry_client = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.enable_socket_keepalive = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.enforce_fips_mode = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.expiration_time = 600 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:07 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.hashclient_retry_attempts = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_dead_retry = 300 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_pool_maxsize = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_sasl_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.password = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.proxies = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.redis_db = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.redis_server = localhost:6379 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.retry_attempts = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.retry_delay = 0.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.socket_keepalive_count = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.socket_keepalive_idle = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.socket_keepalive_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.socket_timeout = 1.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.tls_allowed_ciphers = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.tls_cafile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.tls_certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.tls_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.tls_keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cache.username = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] coordination.backend_url = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.asyncio_connection = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.asyncio_slave_connection = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.backend = sqlalchemy {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.connection = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.connection_debug = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.connection_parameters = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.connection_recycle_time = 3600 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.connection_trace = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.db_inc_retry_interval = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.db_max_retries = 20 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.db_max_retry_interval = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.db_retry_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.max_overflow = 50 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:07 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.max_pool_size = 5 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.max_retries = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.mysql_wsrep_sync_wait = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.pool_timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.retry_interval = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.slave_connection = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.sqlite_synchronous = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.synchronous_reader = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] database.use_db_reconnect = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.connection_string = messaging:// {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.es_doc_type = notification {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.es_scroll_size = 10000 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.es_scroll_time = 2m {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.filter_error_trace = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:08 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.hmac_keys = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.sentinel_service_name = mymaster {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.socket_timeout = 0.1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.trace_requests = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler.trace_sqlalchemy = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler_jaeger.process_tags = {} {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler_jaeger.service_name_prefix = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] profiler_otlp.service_name_prefix = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.enforce_new_defaults = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: WARNING oslo_config.cfg [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.enforce_scope = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.policy_default_rule = default {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.policy_file = policy.yaml {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.group = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.helper_command = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] privsep_osbrick.user = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.group = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.helper_command = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] cinder_sys_admin.user = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.auth_section = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.auth_type = password {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.cafile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.collect_timing = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.send_service_user_token = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.split_loggers = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] service_user.timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.auth_section = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.auth_type = password {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.collect_timing = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.region_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.split_loggers = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] glance.timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.backend_availability_zone = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.chap_password = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.chap_username = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.disk_geometry = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_client_cert = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_client_cert_key = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_data_namespace = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.driver_use_ssl = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.extra_capabilities = {} {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.filter_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.goodness_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iscsi_target_flags = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iscsi_write_cache = on {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iser_helper = tgtadm {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iser_ip_address = 192.168.122.121 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iser_port = 3260 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.lvm_share_target = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.lvm_type = auto {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.num_shell_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.replication_device = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.report_discard_supported = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.reserved_percentage = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_helper = tgtadm {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_ip_address = 192.168.122.121 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_port = 3260 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_protocol = iscsi {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.trace_flags = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.unique_fqdn_network = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.use_chap_auth = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_backend_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_clear = zero {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_clear_ionice = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_clear_size = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_reports.file_event_handler = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_reports.log_dir = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.backend_host = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.chap_password = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.chap_username = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.disk_geometry = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_client_cert = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.extra_capabilities = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.filter_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.goodness_function = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iser_helper = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iser_ip_address = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iser_port = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.lvm_share_target = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.lvm_type = auto {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.num_shell_tries = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.replication_device = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.report_discard_supported = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.reserved_percentage = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.scst_target_driver = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.storage_protocol = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_helper = lioadm {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_ip_address = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_port = 3260 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.trace_flags = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.use_chap_auth = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_clear = zero {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_clear_size = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] lvmdriver-1.volumes_dir = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_notifications.driver = [] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_notifications.retry = -1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] key_manager.fixed_key = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.barbican_api_version = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.barbican_endpoint = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.barbican_endpoint_type = public {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.barbican_region_name = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.cafile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.collect_timing = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack sudo[75683]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.number_of_retries = 60 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.retry_delay = 1 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.send_service_user_token = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.split_loggers = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.verify_ssl = True {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican.verify_ssl_path = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.auth_section = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.auth_type = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.cafile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.certfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.collect_timing = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack sudo[75819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.insecure = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.keyfile = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.split_loggers = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] barbican_service_user.timeout = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.approle_role_id = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.approle_secret_id = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.kv_mountpoint = secret {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack sudo[75819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.kv_path = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.kv_version = 2 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.namespace = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.root_token_id = **** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.ssl_ca_crt_file = None {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.timeout = 60.0 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.use_ssl = False {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:00:08 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] ******************************************************************************** {{(pid=75506) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 11:00:08 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.869s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:08 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:09 devstack sudo[75819]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.695s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:00:09 devstack cinder-volume[75675]: INFO cinder.brick.local_dev.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:09 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:09 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:09 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG cinder.brick.local_dev.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75675) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 30 11:00:09 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:09 devstack sudo[76249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:09 devstack sudo[76249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:10 devstack sudo[76249]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:10 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.124s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:10 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:11 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:11 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:11 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:11 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 30 11:00:11 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:12 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:12 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.612s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:12 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:12 devstack sudo[76466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:12 devstack sudo[76466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:12 devstack sudo[76466]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:12 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:12 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:12 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:12 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:13 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:13 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:13 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:13 devstack sudo[76483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:13 devstack sudo[76483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:14 devstack sudo[76483]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:14 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.711s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:14 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:14 devstack sudo[76488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:14 devstack sudo[76488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:15 devstack sudo[76488]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.792s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:15 devstack sudo[76494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:15 devstack sudo[76494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.863s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:15 devstack sudo[76494]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:15 devstack cinder-volume[75675]: INFO cinder.volume.drivers.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 30 11:00:15 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:16 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:16 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:16 devstack sudo[76508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:16 devstack sudo[76508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:16 devstack sudo[76508]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:16 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:16 devstack cinder-volume[75675]: DEBUG cinder.volume.drivers.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Updating volume stats {{(pid=75675) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 11:00:16 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:16 devstack sudo[76624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:16 devstack sudo[76624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:17 devstack sudo[76624]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.566s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:17 devstack sudo[76716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:17 devstack sudo[76716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:17 devstack cinder-volume[75506]: DEBUG dbcounter [-] [75506] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:00:17 devstack sudo[76716]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:17 devstack sudo[76771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:17 devstack sudo[76771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:18 devstack sudo[76771]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:18 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:18 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:18 devstack sudo[76774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:18 devstack sudo[76774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:19 devstack sudo[76774]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:19 devstack cinder-volume[75675]: INFO cinder.volume.driver [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Driver hasn't implemented _init_vendor_properties() Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG cinder.volume.driver [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75675) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG oslo_db.sqlalchemy.engines [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75675) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG dbcounter [-] [75675] Writer thread running {{(pid=75675) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG cinder.db.sqlalchemy.api [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Building query based on filter {{(pid=75675) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG cinder.image.image_utils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75675) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 11:00:19 devstack cinder-volume[75675]: INFO cinder.keymgr.migration [None req-12767ee8-93b7-4488-bc0f-3862ba733e51 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG cinder.volume.drivers.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Updating volume stats {{(pid=75675) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:19 devstack sudo[76781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:19 devstack sudo[76781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:19 devstack sudo[76781]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:19 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:19 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:19 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:20 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:20 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:20 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:20 devstack sudo[76788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:20 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:21 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.693s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:21 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:21 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:21 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.716s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG cinder.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Notifying Schedulers of capabilities ... {{(pid=75675) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:00:21 devstack cinder-volume[75675]: INFO cinder.volume.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Driver initialization completed successfully. Apr 30 11:00:21 devstack cinder-volume[75675]: INFO cinder.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Initiating service 2 cleanup Apr 30 11:00:21 devstack cinder-volume[75675]: INFO cinder.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Service 2 cleanup completed. Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG cinder.service [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Creating RPC server for service cinder-volume {{(pid=75675) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 11:00:21 devstack cinder-volume[75675]: DEBUG cinder.service [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75675) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 11:00:22 devstack cinder-volume[75675]: INFO cinder.volume.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 30 11:00:22 devstack cinder-volume[75675]: DEBUG cinder.volume.drivers.lvm [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Updating volume stats {{(pid=75675) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 11:00:22 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:22 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:00:22 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:22 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:22 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:22 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:22 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:22 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:23 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:23 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:23 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:23 devstack sudo[76807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:00:23 devstack sudo[76807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:24 devstack sudo[76807]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:24 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:24 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:00:24 devstack sudo[76850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:00:24 devstack sudo[76850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:00:24 devstack sudo[76850]: pam_unix(sudo:session): session closed for user root Apr 30 11:00:24 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:00:24 devstack cinder-volume[75675]: INFO cinder.volume.manager [None req-f3f42f65-b126-4a07-8804-368f612e9a92 None None] Driver post RPC initialization completed successfully. Apr 30 11:00:31 devstack cinder-volume[75675]: DEBUG dbcounter [-] [75675] Writing DB stats cinder:SELECT=2 {{(pid=75675) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:00:34 devstack cinder-volume[75675]: DEBUG dbcounter [-] [75675] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75675) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:01:46 devstack cinder-volume[75675]: DEBUG oslo_service.periodic_task [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75675) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:01:46 devstack cinder-volume[75675]: DEBUG cinder.volume.drivers.lvm [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Updating volume stats {{(pid=75675) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 11:01:46 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:46 devstack sudo[81432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:01:46 devstack sudo[81432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:47 devstack sudo[81432]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:47 devstack sudo[81561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:01:47 devstack sudo[81561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:47 devstack sudo[81561]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:47 devstack sudo[81566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:01:47 devstack sudo[81566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:48 devstack sudo[81566]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:48 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:48 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:01:48 devstack sudo[81572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:01:48 devstack sudo[81572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:01:49 devstack sudo[81572]: pam_unix(sudo:session): session closed for user root Apr 30 11:01:49 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.671s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:01:49 devstack cinder-volume[75675]: DEBUG cinder.manager [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Notifying Schedulers of capabilities ... {{(pid=75675) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:02:34 devstack cinder-volume[75675]: DEBUG dbcounter [-] [75675] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75675) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:02:46 devstack cinder-volume[75675]: DEBUG oslo_service.periodic_task [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75675) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:02:46 devstack cinder-volume[75675]: DEBUG cinder.volume.drivers.lvm [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Updating volume stats {{(pid=75675) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 30 11:02:46 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:46 devstack sudo[82000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 30 11:02:46 devstack sudo[82000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:47 devstack sudo[82000]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:47 devstack sudo[82003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:02:47 devstack sudo[82003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:47 devstack sudo[82003]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:47 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:47 devstack sudo[82007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 30 11:02:47 devstack sudo[82007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:48 devstack sudo[82007]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:48 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:48 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:02:48 devstack sudo[82010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 30 11:02:48 devstack sudo[82010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:02:49 devstack sudo[82010]: pam_unix(sudo:session): session closed for user root Apr 30 11:02:49 devstack cinder-volume[75675]: DEBUG oslo_concurrency.processutils [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=75675) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:02:49 devstack cinder-volume[75675]: DEBUG cinder.manager [None req-4114dad6-828e-4803-a3ea-11be8ed2356b None None] Notifying Schedulers of capabilities ... {{(pid=75675) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:15 devstack cinder-volume[75506]: INFO oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Caught SIGTERM, stopping children Apr 30 11:03:15 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Acquiring lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:15 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Acquired lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:15 devstack cinder-volume[75506]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Releasing lock "singleton_lock" {{(pid=75506) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:15 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Stop services. {{(pid=75506) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 30 11:03:15 devstack cinder-volume[75506]: DEBUG oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Killing children. {{(pid=75506) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 30 11:03:15 devstack cinder-volume[75506]: INFO oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Waiting on 1 children to exit Apr 30 11:03:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Acquiring lock "singleton_lock" {{(pid=75675) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Acquired lock "singleton_lock" {{(pid=75675) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:17 devstack cinder-volume[75675]: DEBUG oslo_concurrency.lockutils [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Releasing lock "singleton_lock" {{(pid=75675) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:17 devstack cinder-volume[75675]: WARNING amqp [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 11:03:17 devstack cinder-volume[75675]: WARNING amqp [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 11:03:17 devstack cinder-volume[75506]: INFO oslo_service.backend._eventlet.service [None req-3b6355f6-9f10-4ce8-be00-fdb4473aceb7 None None] Child 75675 exited with status 0 Apr 30 11:03:19 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:19 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:19 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:20 devstack cinder-volume[83337]: INFO dbcounter [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Registered counter for database cinder Apr 30 11:03:20 devstack cinder-volume[83337]: DEBUG oslo_db.sqlalchemy.engines [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:20 devstack cinder-volume[83337]: DEBUG dbcounter [-] [83337] Writer thread running {{(pid=83337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:03:20 devstack cinder-volume[83337]: INFO cinder.rpc [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 11:03:20 devstack cinder-volume[83337]: INFO cinder.rpc [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 11:03:20 devstack cinder-volume[83337]: DEBUG oslo_db.sqlalchemy.engines [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:20 devstack cinder-volume[83337]: INFO cinder.volume.manager [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Determined volume DB was empty at startup. Apr 30 11:03:20 devstack cinder-volume[83337]: DEBUG cinder.volume.manager [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83337) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 11:03:20 devstack cinder-volume[83337]: INFO cinder.volume.manager [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 30 11:03:20 devstack cinder-volume[83337]: WARNING stevedore.named [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 11:03:20 devstack cinder-volume[83337]: WARNING castellan.key_manager [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:03:20 devstack cinder-volume[83337]: WARNING cinder.keymgr.conf_key_mgr [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:03:20 devstack cinder-volume[83337]: INFO cinder.volume.manager [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 30 11:03:20 devstack cinder-volume[83337]: DEBUG oslo_db.sqlalchemy.engines [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:20 devstack cinder-volume[83337]: INFO oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Starting 1 workers Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Started child 83618 {{(pid=83337) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Full set of CONF: {{(pid=83337) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] ******************************************************************************** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Configuration options gathered from: {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] ================================================================================ {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] allow_availability_zone_fallback = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] allow_compression_on_image_upload = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83618]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] allowed_direct_url_schemes = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] api_rate_limit = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] auth_strategy = keystone {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_availability_zone = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_host = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_stats_polling_interval = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backup_api_class = cinder.backup.api.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backup_name_template = backup-%s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backup_use_same_host = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backup_use_temp_snapshot = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] chap_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] chap_username = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_internal_tenant_project_id = 45ad17edd8bd403981fee8d5367e0aed {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_internal_tenant_user_id = 2b004444569f4f69a53cd90475090278 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cluster = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] compression_format = gzip {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] compute_api_class = cinder.compute.nova.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] config_dir = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] config_source = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] control_exchange = openstack {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] debug = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] default_availability_zone = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] default_group_type = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] default_volume_type = QuobyteHD {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] disk_geometry = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_client_cert = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_client_cert_key = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_data_namespace = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_ssl_cert_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_ssl_cert_verify = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] driver_use_ssl = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] enable_new_services = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] enable_unsupported_driver = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] enabled_backends = ['QuobyteHD'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] enforce_multipath_for_image_xfer = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] filter_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_api_insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_api_servers = ['http://192.168.122.121/image'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_api_ssl_compression = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_ca_certificates_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_catalog_info = image:glance:publicURL {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83618]: INFO cinder.volume.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.remotefs [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83618) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_num_retries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance_request_timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] goodness_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] graceful_shutdown_timeout = 5 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] group_api_class = cinder.group.api.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] host = devstack {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_compress_on_upload = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_conversion_address_space_limit = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_conversion_cpu_limit = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_conversion_disable = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_upload_use_cinder_backend = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_upload_use_internal_tenant = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_volume_cache_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_volume_cache_max_count = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] image_volume_cache_max_size_gb = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] init_host_max_objects_retrieval = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] instance_format = [instance: %(uuid)s] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iscsi_target_flags = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iscsi_write_cache = on {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iser_helper = tgtadm {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iser_ip_address = 192.168.122.121 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iser_port = 3260 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_color = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_config_append = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_dir = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_options = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_rotate_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_rotate_interval_type = days {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] log_rotation_type = none {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] max_age = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] max_logfile_count = 30 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] max_logfile_size_mb = 200 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] max_over_subscription_ratio = 20.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] message_reap_interval = 86400 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] message_ttl = 2592000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] migration_create_volume_timeout_secs = 300 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] monkey_patch = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] monkey_patch_modules = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] my_ip = 192.168.122.121 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] no_snapshot_gb_quota = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] num_iser_scan_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] num_shell_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] num_volume_device_scan_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] nvmeof_conn_info_version = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] nvmet_ns_id = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] nvmet_port_id = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_max_limit = 1000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_ext_list = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_listen_port = 8776 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_use_ssl = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] osapi_volume_workers = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] per_volume_size_limit = -1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] periodic_fuzzy_delay = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] periodic_interval = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] public_endpoint = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] publish_errors = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_backup_gigabytes = 1000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_backups = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_gigabytes = 1000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_groups = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_snapshots = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] quota_volumes = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] rate_limit_burst = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] rate_limit_except_level = CRITICAL {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] rate_limit_interval = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] reinit_driver_count = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] replication_device = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] report_discard_supported = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] report_interval = 120 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] reservation_clean_interval = 86400 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] reservation_expire = 86400 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] reserved_image_namespaces = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] reserved_percentage = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] rpc_response_timeout = 120 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] run_external_periodic_tasks = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] scst_target_driver = iscsi {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] scst_target_iqn_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_down_time = 720 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] shell_completion = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] snapshot_name_template = snapshot-%s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] split_loggers = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] state_path = /opt/stack/data/cinder {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] storage_availability_zone = nova {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] storage_protocol = iSCSI {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] syslog_log_facility = LOG_USER {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_helper = lioadm {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_ip_address = 192.168.122.121 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_port = 3260 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_protocol = iscsi {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] target_secondary_ip_addresses = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83618) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 30 11:03:21 devstack cinder-volume[83618]: WARNING cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] trace_flags = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] transport_url = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] until_refresh = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_chap_auth = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_default_quota_class = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83618]: WARNING cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Running cmd (subprocess): mount.quobyte {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_journal = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_json = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_multipath_for_image_xfer = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_stderr = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] use_syslog = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] verify_glance_signatures = enabled {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_api_class = cinder.volume.api.API {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_backend_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_clear = zero {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_clear_ionice = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_clear_size = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_copy_bps_limit = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_dd_blocksize = 1M {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_name_template = volume-%s {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_service_inithost_offload = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volume_usage_audit_period = month {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] zoning_mode = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_concurrency.disable_process_locking = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.admin_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.admin_token = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.admin_user = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_port = 35357 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_protocol = https {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_section = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_type = password {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_uri = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.auth_version = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.cache = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.identity_uri = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.include_service_catalog = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.interface = public {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_password = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcache_username = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.region_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.service_type = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.121/identity {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.backend = dogpile.cache.null {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.backend_argument = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.backend_expiration_time = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.config_prefix = cache.oslo {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.debug_cache_backend = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.enable_retry_client = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.enable_socket_keepalive = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.enforce_fips_mode = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.expiration_time = 600 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.hashclient_retry_attempts = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_dead_retry = 300 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_pool_maxsize = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_sasl_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.proxies = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.redis_db = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.redis_server = localhost:6379 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.retry_attempts = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.retry_delay = 0.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.socket_keepalive_count = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.socket_keepalive_idle = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.socket_keepalive_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.socket_timeout = 1.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.tls_allowed_ciphers = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.tls_cafile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.tls_certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.tls_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.tls_keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cache.username = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] coordination.backend_url = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.asyncio_connection = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.asyncio_slave_connection = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.backend = sqlalchemy {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.connection = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.connection_debug = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.connection_parameters = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.connection_recycle_time = 3600 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.connection_trace = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.db_inc_retry_interval = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.db_max_retries = 20 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.db_max_retry_interval = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.db_retry_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.max_overflow = 50 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.max_pool_size = 5 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.max_retries = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.mysql_wsrep_sync_wait = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.pool_timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.retry_interval = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack quobyte-client[83620]: Reading configuration file: /etc/quobyte/client.cfg Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.slave_connection = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack quobyte-client[83620]: Invalid parameters found, error: missing mount point. Apr 30 11:03:21 devstack quobyte-client[83620]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] CMD "mount.quobyte" returned: 1 in 0.158s {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:21 devstack quobyte-client[83620]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.sqlite_synchronous = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=83618) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.synchronous_reader = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] database.use_db_reconnect = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83618]: INFO cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 ... Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.connection_string = messaging:// {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.es_doc_type = notification {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d -c /etc/quobyte/client-cinder.cfg {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.es_scroll_size = 10000 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.es_scroll_time = 2m {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.filter_error_trace = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.hmac_keys = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.sentinel_service_name = mymaster {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.socket_timeout = 0.1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.trace_requests = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler.trace_sqlalchemy = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler_jaeger.process_tags = {} {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler_jaeger.service_name_prefix = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] profiler_otlp.service_name_prefix = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.enforce_new_defaults = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: WARNING oslo_config.cfg [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.enforce_scope = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.policy_default_rule = default {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.policy_file = policy.yaml {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.group = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d -c /etc/quobyte/client-cinder.cfg Apr 30 11:03:21 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.helper_command = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] privsep_osbrick.user = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.group = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.helper_command = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] cinder_sys_admin.user = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.auth_section = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.auth_type = password {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.cafile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.collect_timing = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.send_service_user_token = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.split_loggers = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] service_user.timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.auth_section = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.auth_type = password {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.collect_timing = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.region_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.split_loggers = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] glance.timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.backend_availability_zone = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.chap_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.chap_username = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.disk_geometry = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_client_cert = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_client_cert_key = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_data_namespace = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.driver_use_ssl = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.extra_capabilities = {} {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.filter_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.goodness_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iscsi_target_flags = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iscsi_write_cache = on {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iser_helper = tgtadm {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iser_ip_address = 192.168.122.121 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iser_port = 3260 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_host = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_login = admin {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_mount_options = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_private_key = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_share_path = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.num_shell_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.quobyte_volume_url = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.replication_device = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.report_discard_supported = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.reserved_percentage = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_helper = tgtadm {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_ip_address = 192.168.122.121 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_port = 3260 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_protocol = iscsi {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.trace_flags = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.unique_fqdn_network = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.use_chap_auth = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_backend_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_clear = zero {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_clear_ionice = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_clear_size = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_reports.file_event_handler = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_reports.log_dir = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.backend_availability_zone = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.backend_host = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.chap_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.chap_username = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.chiscsi_conf = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.disk_geometry = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_client_cert = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_data_namespace = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.driver_use_ssl = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.extra_capabilities = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.filter_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.goodness_function = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iser_helper = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iser_ip_address = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iser_port = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.iser_target_prefix = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_host = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_login = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_mount_options = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_password = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_private_key = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_share_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_ssh_port = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.num_shell_tries = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.nvmet_port_id = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.replication_device = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.report_discard_supported = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.reserved_percentage = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.scst_target_driver = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.storage_protocol = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_helper = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_ip_address = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_port = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_prefix = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_protocol = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.trace_flags = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.use_chap_auth = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_clear = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_clear_size = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] QuobyteHD.volumes_dir = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_notifications.driver = [] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_notifications.retry = -1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] key_manager.fixed_key = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.barbican_api_version = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.barbican_endpoint = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.barbican_endpoint_type = public {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.barbican_region_name = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.cafile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.collect_timing = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.number_of_retries = 60 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.retry_delay = 1 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.send_service_user_token = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.split_loggers = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.verify_ssl = True {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican.verify_ssl_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.auth_section = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.auth_type = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.cafile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.certfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.collect_timing = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.insecure = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.keyfile = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.split_loggers = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] barbican_service_user.timeout = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.approle_role_id = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.approle_secret_id = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.kv_mountpoint = secret {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.kv_path = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.kv_version = 2 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.namespace = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.root_token_id = **** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.ssl_ca_crt_file = None {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.timeout = 60.0 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.use_ssl = False {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:21 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] ******************************************************************************** {{(pid=83337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 11:03:22 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.810s {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:22 devstack cinder-volume[83618]: INFO cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 succeeded Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=83618) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.827s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:22 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:22 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:22 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.612s {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:22 devstack cinder-volume[83618]: INFO cinder.volume.driver [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Driver hasn't implemented _init_vendor_properties() Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.volume.driver [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6563110351562, 'free_capacity_gb': 1775.6563110351562, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83618) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_db.sqlalchemy.engines [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83618) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG dbcounter [-] [83618] Writer thread running {{(pid=83618) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.db.sqlalchemy.api [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Building query based on filter {{(pid=83618) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.image.image_utils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83618) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 11:03:22 devstack cinder-volume[83618]: INFO cinder.keymgr.migration [None req-2ef81c6a-c770-4b15-911a-eb926cf3b68d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=83618) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=83618) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:22 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:22 devstack sudo[83733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:22 devstack sudo[83733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:23 devstack sudo[83733]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.681s {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG cinder.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Notifying Schedulers of capabilities ... {{(pid=83618) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:23 devstack cinder-volume[83618]: INFO cinder.volume.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Driver initialization completed successfully. Apr 30 11:03:23 devstack cinder-volume[83618]: INFO cinder.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Initiating service 3 cleanup Apr 30 11:03:23 devstack cinder-volume[83618]: INFO cinder.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Service 3 cleanup completed. Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG cinder.service [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Creating RPC server for service cinder-volume {{(pid=83618) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG cinder.service [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83618) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 11:03:23 devstack cinder-volume[83618]: INFO cinder.volume.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:23 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=83618) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:24 devstack cinder-volume[83618]: DEBUG cinder.volume.drivers.quobyte [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=83618) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:24 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83618) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:24 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:24 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:24 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:25 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:25 devstack cinder-volume[83618]: DEBUG oslo_concurrency.processutils [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.146s {{(pid=83618) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:25 devstack cinder-volume[83618]: INFO cinder.volume.manager [None req-5b18016a-b80e-4de4-ba9a-672cd3d76184 None None] Driver post RPC initialization completed successfully. Apr 30 11:03:26 devstack cinder-volume[83337]: INFO oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Caught SIGTERM, stopping children Apr 30 11:03:26 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Acquiring lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:26 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Acquired lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:26 devstack cinder-volume[83337]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Releasing lock "singleton_lock" {{(pid=83337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:26 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Stop services. {{(pid=83337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 30 11:03:26 devstack cinder-volume[83337]: DEBUG oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Killing children. {{(pid=83337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 30 11:03:26 devstack cinder-volume[83337]: INFO oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Waiting on 1 children to exit Apr 30 11:03:28 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Acquiring lock "singleton_lock" {{(pid=83618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:28 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Acquired lock "singleton_lock" {{(pid=83618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:28 devstack cinder-volume[83618]: DEBUG oslo_concurrency.lockutils [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Releasing lock "singleton_lock" {{(pid=83618) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:28 devstack cinder-volume[83618]: WARNING amqp [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 11:03:28 devstack cinder-volume[83618]: WARNING amqp [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 30 11:03:28 devstack cinder-volume[83337]: INFO oslo_service.backend._eventlet.service [None req-703c9973-acc4-4192-b475-48ec6bb7b975 None None] Child 83618 exited with status 0 Apr 30 11:03:31 devstack cinder-volume[83967]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 30 11:03:31 devstack cinder-volume[83967]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 30 11:03:31 devstack cinder-volume[83967]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 30 11:03:32 devstack cinder-volume[83967]: INFO dbcounter [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Registered counter for database cinder Apr 30 11:03:32 devstack cinder-volume[83967]: DEBUG oslo_db.sqlalchemy.engines [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83967) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:32 devstack cinder-volume[83967]: DEBUG dbcounter [-] [83967] Writer thread running {{(pid=83967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:03:32 devstack cinder-volume[83967]: INFO cinder.rpc [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 30 11:03:32 devstack cinder-volume[83967]: INFO cinder.rpc [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 30 11:03:32 devstack cinder-volume[83967]: DEBUG oslo_db.sqlalchemy.engines [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83967) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:33 devstack cinder-volume[83967]: INFO cinder.volume.manager [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Determined volume DB was empty at startup. Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG cinder.volume.manager [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83967) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 30 11:03:33 devstack cinder-volume[83967]: WARNING stevedore.named [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 30 11:03:33 devstack cinder-volume[83967]: WARNING castellan.key_manager [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:03:33 devstack cinder-volume[83967]: WARNING cinder.keymgr.conf_key_mgr [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 30 11:03:33 devstack cinder-volume[83967]: INFO cinder.volume.manager [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_db.sqlalchemy.engines [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83967) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:33 devstack cinder-volume[83967]: INFO oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Starting 1 workers Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Started child 84206 {{(pid=83967) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Full set of CONF: {{(pid=83967) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] ******************************************************************************** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Configuration options gathered from: {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] ================================================================================ {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] allow_availability_zone_fallback = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] allow_compression_on_image_upload = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] allowed_direct_url_schemes = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] api_rate_limit = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] auth_strategy = keystone {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_availability_zone = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_host = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_stats_polling_interval = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backup_api_class = cinder.backup.api.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backup_name_template = backup-%s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backup_use_same_host = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backup_use_temp_snapshot = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] chap_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] chap_username = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_internal_tenant_project_id = 45ad17edd8bd403981fee8d5367e0aed {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_internal_tenant_user_id = 2b004444569f4f69a53cd90475090278 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cluster = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] compression_format = gzip {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] compute_api_class = cinder.compute.nova.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] config_dir = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] config_source = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] control_exchange = openstack {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[84206]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] debug = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] default_availability_zone = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] default_group_type = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] default_volume_type = QuobyteHD {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] disk_geometry = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_client_cert = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_client_cert_key = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_data_namespace = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_ssl_cert_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_ssl_cert_verify = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] driver_use_ssl = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] enable_new_services = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] enable_unsupported_driver = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] enabled_backends = ['QuobyteHD'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] enforce_multipath_for_image_xfer = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] filter_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_api_insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_api_servers = ['http://192.168.122.121/image'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_api_ssl_compression = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_ca_certificates_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_catalog_info = image:glance:publicURL {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_num_retries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance_request_timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] goodness_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] graceful_shutdown_timeout = 5 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] group_api_class = cinder.group.api.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] host = devstack {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_compress_on_upload = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_conversion_address_space_limit = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_conversion_cpu_limit = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_conversion_disable = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_upload_use_cinder_backend = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_upload_use_internal_tenant = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_volume_cache_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_volume_cache_max_count = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] image_volume_cache_max_size_gb = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] init_host_max_objects_retrieval = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] instance_format = [instance: %(uuid)s] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iscsi_target_flags = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iscsi_write_cache = on {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iser_helper = tgtadm {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iser_ip_address = 192.168.122.121 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iser_port = 3260 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_color = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_config_append = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_dir = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_options = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_rotate_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_rotate_interval_type = days {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] log_rotation_type = none {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] max_age = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] max_logfile_count = 30 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] max_logfile_size_mb = 200 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] max_over_subscription_ratio = 20.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] message_reap_interval = 86400 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] message_ttl = 2592000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] migration_create_volume_timeout_secs = 300 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] monkey_patch = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] monkey_patch_modules = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] my_ip = 192.168.122.121 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] no_snapshot_gb_quota = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] num_iser_scan_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] num_shell_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] num_volume_device_scan_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] nvmeof_conn_info_version = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] nvmet_ns_id = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] nvmet_port_id = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_max_limit = 1000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_ext_list = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_listen_port = 8776 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_use_ssl = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] osapi_volume_workers = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] per_volume_size_limit = -1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] periodic_fuzzy_delay = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] periodic_interval = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] public_endpoint = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] publish_errors = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_backup_gigabytes = 1000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_backups = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_gigabytes = 1000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_groups = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_snapshots = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] quota_volumes = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] rate_limit_burst = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] rate_limit_except_level = CRITICAL {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] rate_limit_interval = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] reinit_driver_count = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] replication_device = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] report_discard_supported = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] report_interval = 120 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] reservation_clean_interval = 86400 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] reservation_expire = 86400 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] reserved_image_namespaces = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] reserved_percentage = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] rpc_response_timeout = 120 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] run_external_periodic_tasks = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] scst_target_driver = iscsi {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] scst_target_iqn_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_down_time = 720 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] shell_completion = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] snapshot_name_template = snapshot-%s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] split_loggers = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] state_path = /opt/stack/data/cinder {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] storage_availability_zone = nova {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] storage_protocol = iSCSI {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] syslog_log_facility = LOG_USER {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_helper = lioadm {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_ip_address = 192.168.122.121 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_port = 3260 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_protocol = iscsi {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] target_secondary_ip_addresses = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] trace_flags = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] transport_url = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] until_refresh = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_chap_auth = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_default_quota_class = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_journal = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_json = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_multipath_for_image_xfer = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_stderr = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] use_syslog = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] verify_glance_signatures = enabled {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_api_class = cinder.volume.api.API {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_backend_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_clear = zero {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_clear_ionice = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_clear_size = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_copy_bps_limit = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_dd_blocksize = 1M {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_name_template = volume-%s {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_service_inithost_offload = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volume_usage_audit_period = month {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] zoning_mode = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_concurrency.disable_process_locking = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.admin_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.admin_token = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.admin_user = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_port = 35357 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_protocol = https {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_section = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_type = password {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_uri = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.auth_version = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.cache = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.identity_uri = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.include_service_catalog = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.interface = public {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_password = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Starting volume driver QuobyteDriver (1.1.14) Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84206) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcache_username = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.region_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.service_type = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.121/identity {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.backend = dogpile.cache.null {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.backend_argument = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.backend_expiration_time = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.config_prefix = cache.oslo {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.debug_cache_backend = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.enable_retry_client = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.enable_socket_keepalive = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.enforce_fips_mode = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.expiration_time = 600 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.hashclient_retry_attempts = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_dead_retry = 300 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_pool_maxsize = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_sasl_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.proxies = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.redis_db = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.redis_server = localhost:6379 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.retry_attempts = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.retry_delay = 0.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.socket_keepalive_count = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.socket_keepalive_idle = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.socket_keepalive_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.socket_timeout = 1.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.tls_allowed_ciphers = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.tls_cafile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.tls_certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.tls_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.tls_keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cache.username = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] coordination.backend_url = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.asyncio_connection = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.asyncio_slave_connection = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.backend = sqlalchemy {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.connection = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.connection_debug = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.connection_parameters = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.connection_recycle_time = 3600 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.connection_trace = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.db_inc_retry_interval = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.db_max_retries = 20 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.db_max_retry_interval = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.db_retry_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.max_overflow = 50 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.max_pool_size = 5 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.max_retries = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.mysql_wsrep_sync_wait = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.pool_timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.retry_interval = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.slave_connection = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.sqlite_synchronous = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.synchronous_reader = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] database.use_db_reconnect = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.connection_string = messaging:// {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.es_doc_type = notification {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.es_scroll_size = 10000 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.es_scroll_time = 2m {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.filter_error_trace = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.hmac_keys = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.sentinel_service_name = mymaster {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.socket_timeout = 0.1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.trace_requests = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler.trace_sqlalchemy = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler_jaeger.process_tags = {} {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler_jaeger.service_name_prefix = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] profiler_otlp.service_name_prefix = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.enforce_new_defaults = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: WARNING oslo_config.cfg [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.enforce_scope = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.policy_default_rule = default {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.policy_file = policy.yaml {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.group = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.helper_command = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] privsep_osbrick.user = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.group = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.helper_command = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] cinder_sys_admin.user = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.auth_section = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.auth_type = password {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.cafile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.collect_timing = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.send_service_user_token = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.split_loggers = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] service_user.timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.auth_section = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.auth_type = password {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.collect_timing = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.region_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.split_loggers = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] glance.timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.backend_availability_zone = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.chap_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.chap_username = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.disk_geometry = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_client_cert = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_client_cert_key = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_data_namespace = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.driver_use_ssl = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.extra_capabilities = {} {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.filter_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.goodness_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iscsi_target_flags = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iscsi_write_cache = on {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iser_helper = tgtadm {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iser_ip_address = 192.168.122.121 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iser_port = 3260 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_host = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_login = admin {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_mount_options = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_private_key = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_share_path = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.num_shell_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.quobyte_volume_url = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.replication_device = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.report_discard_supported = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.reserved_percentage = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_helper = tgtadm {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_ip_address = 192.168.122.121 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_port = 3260 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_protocol = iscsi {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.trace_flags = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.unique_fqdn_network = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.use_chap_auth = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_backend_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_clear = zero {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_clear_ionice = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_clear_size = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_reports.file_event_handler = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_reports.log_dir = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.backend_availability_zone = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.backend_host = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.chap_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.chap_username = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.chiscsi_conf = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.disk_geometry = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_client_cert = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_data_namespace = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.driver_use_ssl = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack sudo[84211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.extra_capabilities = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.filter_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.goodness_function = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack sudo[84211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iser_helper = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iser_ip_address = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iser_port = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.iser_target_prefix = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_host = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_login = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_mount_options = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_password = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_private_key = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_share_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_ssh_port = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.num_shell_tries = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.nvmet_port_id = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.replication_device = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.report_discard_supported = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.reserved_percentage = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.scst_target_driver = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.storage_protocol = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_helper = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_ip_address = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_port = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_prefix = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_protocol = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.trace_flags = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.use_chap_auth = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_clear = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_clear_size = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] QuobyteHD.volumes_dir = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_notifications.driver = [] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_notifications.retry = -1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] key_manager.fixed_key = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.barbican_api_version = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84206) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 30 11:03:33 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 30 11:03:33 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Running cmd (subprocess): mount.quobyte {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.barbican_endpoint = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.barbican_endpoint_type = public {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.barbican_region_name = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.cafile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.collect_timing = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.number_of_retries = 60 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.retry_delay = 1 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.send_service_user_token = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.split_loggers = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.verify_ssl = True {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican.verify_ssl_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.auth_section = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.auth_type = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.cafile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.certfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.collect_timing = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.insecure = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.keyfile = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.split_loggers = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] barbican_service_user.timeout = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.approle_role_id = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.approle_secret_id = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.kv_mountpoint = secret {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.kv_path = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.kv_version = 2 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.namespace = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.root_token_id = **** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.ssl_ca_crt_file = None {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.timeout = 60.0 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.use_ssl = False {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 30 11:03:33 devstack cinder-volume[83967]: DEBUG oslo_service.backend._eventlet.service [None req-fb326f7e-ac0e-42f8-84bb-1a081f604a92 None None] ******************************************************************************** {{(pid=83967) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:34 devstack sudo[84211]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.709s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:34 devstack cinder-volume[84206]: INFO cinder.volume.driver [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Driver hasn't implemented _init_vendor_properties() Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG cinder.volume.driver [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6563110351562, 'free_capacity_gb': 1775.6563110351562, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84206) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_db.sqlalchemy.engines [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writer thread running {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG cinder.db.sqlalchemy.api [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Building query based on filter {{(pid=84206) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84206) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:34 devstack cinder-volume[84206]: INFO cinder.keymgr.migration [None req-3eafbfd4-d258-4103-86c2-9e724ae64a34 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 30 11:03:34 devstack sudo[84219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:34 devstack sudo[84219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.763s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:03:35 devstack sudo[84219]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Driver initialization completed successfully. Apr 30 11:03:35 devstack cinder-volume[84206]: INFO cinder.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Initiating service 3 cleanup Apr 30 11:03:35 devstack cinder-volume[84206]: INFO cinder.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Service 3 cleanup completed. Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG cinder.service [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Creating RPC server for service cinder-volume {{(pid=84206) start /opt/stack/cinder/cinder/service.py:231}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG cinder.service [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84206) start /opt/stack/cinder/cinder/service.py:237}} Apr 30 11:03:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:03:35 devstack sudo[84262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:03:35 devstack sudo[84262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:03:35 devstack sudo[84262]: pam_unix(sudo:session): session closed for user root Apr 30 11:03:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.594s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:03:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dcd00c1a-8603-463b-86fa-d301802922dc None None] Driver post RPC initialization completed successfully. Apr 30 11:03:43 devstack cinder-volume[83967]: DEBUG dbcounter [-] [83967] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83967) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:03:45 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:03:45 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=3 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Flow 'volume_create_manager' (e9a8a39a-de3c-45dd-a433-91976b3c144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cad0217-3ff5-4153-a213-f43a47613a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cad0217-3ff5-4153-a213-f43a47613a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1776857724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79922a7-5f9d-4d90-8bb2-7233155654e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c9f06110464300ae048986cbaa1a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:44Z,use_quota=True,user_id='f2eef1f173664ca89404aeafef9e57b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc76d2e-f4ab-4339-96eb-c25ae82bb79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc76d2e-f4ab-4339-96eb-c25ae82bb79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734f8e4d-cb34-43c9-8b87-b4614d16f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734f8e4d-cb34-43c9-8b87-b4614d16f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79922a7-5f9d-4d90-8bb2-7233155654e1', 'volume_name': 'volume-c79922a7-5f9d-4d90-8bb2-7233155654e1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f27194-73f1-48f4-91bc-735d84407cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f27194-73f1-48f4-91bc-735d84407cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d4885a-3aed-46d8-a9b9-4a4d580f0ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:44 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Volume c79922a7-5f9d-4d90-8bb2-7233155654e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79922a7-5f9d-4d90-8bb2-7233155654e1', 'volume_size': 1} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1776857724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79922a7-5f9d-4d90-8bb2-7233155654e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c9f06110464300ae048986cbaa1a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:44Z,use_quota=True,user_id='f2eef1f173664ca89404aeafef9e57b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Creating volume c79922a7-5f9d-4d90-8bb2-7233155654e1 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:44 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:04:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:44 devstack sudo[84643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 1073741824 Apr 30 11:04:44 devstack sudo[84643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:46 devstack sudo[84643]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 1073741824" returned: 0 in 1.977s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:47 devstack sudo[85037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 Apr 30 11:04:47 devstack sudo[85037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:48 devstack sudo[85037]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1" returned: 0 in 1.614s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] <== create_volume: return (3765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.776s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d4885a-3aed-46d8-a9b9-4a4d580f0ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79922a7-5f9d-4d90-8bb2-7233155654e1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892524b6-a939-4504-8337-1780d8ba14b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Volume volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 (c79922a7-5f9d-4d90-8bb2-7233155654e1): created successfully Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892524b6-a939-4504-8337-1780d8ba14b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Flow 'volume_create_manager' (e9a8a39a-de3c-45dd-a433-91976b3c144b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c52e77c9-c20d-4da5-9ce1-a9487a461e57 tempest-DeleteServersTestJSON-373016684 None] Created volume successfully. Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Flow 'volume_create_manager' (7d791a29-464c-42cb-a9bc-3efab0611784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c723a-5f62-483e-9786-b9204eeafe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (163c723a-5f62-483e-9786-b9204eeafe9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1587308771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd77107-b8e5-46d5-bc46-2bce23530346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18b414adf504ddab63bbdbf583a4fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:52Z,use_quota=True,user_id='017bd6bc7bb845858e13620e00f4db57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f10e09-dc8f-42af-aa3c-45578d504d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33f10e09-dc8f-42af-aa3c-45578d504d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f659da-8ee2-4676-ab1c-041b30991efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f659da-8ee2-4676-ab1c-041b30991efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bd77107-b8e5-46d5-bc46-2bce23530346', 'volume_name': 'volume-9bd77107-b8e5-46d5-bc46-2bce23530346', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c94a98-a506-4eb7-91b1-c961926aae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c94a98-a506-4eb7-91b1-c961926aae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d18b6c5-e5c4-4799-adf7-a2d6f32f6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:51 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Volume 9bd77107-b8e5-46d5-bc46-2bce23530346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bd77107-b8e5-46d5-bc46-2bce23530346', 'volume_size': 1} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1587308771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bd77107-b8e5-46d5-bc46-2bce23530346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18b414adf504ddab63bbdbf583a4fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:04:52Z,use_quota=True,user_id='017bd6bc7bb845858e13620e00f4db57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Creating volume 9bd77107-b8e5-46d5-bc46-2bce23530346 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:04:51 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:04:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:51 devstack sudo[85106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 1073741824 Apr 30 11:04:51 devstack sudo[85106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:53 devstack sudo[85106]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 1073741824" returned: 0 in 1.597s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:53 devstack sudo[85137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 Apr 30 11:04:53 devstack sudo[85137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:54 devstack sudo[85137]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346" returned: 0 in 1.376s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] <== create_volume: return (3045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.047s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d18b6c5-e5c4-4799-adf7-a2d6f32f6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bd77107-b8e5-46d5-bc46-2bce23530346', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd70b8a-53e1-4cd4-bf32-08acef5df075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:04:54 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Volume volume-9bd77107-b8e5-46d5-bc46-2bce23530346 (9bd77107-b8e5-46d5-bc46-2bce23530346): created successfully Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cd70b8a-53e1-4cd4-bf32-08acef5df075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:04:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Flow 'volume_create_manager' (7d791a29-464c-42cb-a9bc-3efab0611784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:04:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3498213f-15a0-4482-9665-27d6705bac39 tempest-VolumesAdminNegativeTest-12739629 None] Created volume successfully. Apr 30 11:04:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Acquiring lock "cinder-9bd77107-b8e5-46d5-bc46-2bce23530346-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "cinder-9bd77107-b8e5-46d5-bc46-2bce23530346-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Acquiring lock "cinder-quobyte-9bd77107-b8e5-46d5-bc46-2bce23530346" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:04:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "cinder-quobyte-9bd77107-b8e5-46d5-bc46-2bce23530346" acquired by "delete_volume" :: waited 0.036s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:04:56 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp32nqa65f/privsep.sock'] Apr 30 11:04:56 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp32nqa65f/privsep.sock Apr 30 11:04:56 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:57 devstack cinder-volume[84206]: WARNING py.warnings [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 30 11:04:57 devstack cinder-volume[84206]: .first() Apr 30 11:04:57 devstack cinder-volume[84206]: Apr 30 11:04:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:04:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:04:58 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:58 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Spawned new privsep daemon via rootwrap Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Accepted privsep connection to /tmp/tmp32nqa65f/privsep.sock {{(pid=84206) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 30 11:04:58 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 30 11:04:58 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 30 11:04:58 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 30 11:04:58 devstack cinder-volume[84206]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85171 Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83c9d08-722c-439c-8710-51d7c723e121]: (2,) {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:58 devstack cinder-volume[84206]: WARNING oslo_privsep.priv_context [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] privsep daemon already running Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58fb6aa-35d7-41be-8dee-740802f09092]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[205acf8e-42ad-46d4-be44-8d1876f1b470]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:04:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:04:59 devstack sudo[85175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 Apr 30 11:04:59 devstack sudo[85175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:59 devstack sudo[85174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 Apr 30 11:04:59 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:04:59 devstack sudo[85175]: pam_unix(sudo:session): session closed for user root Apr 30 11:04:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1" returned: 0 in 1.084s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:04:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.802s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085', 'name': 'volume-c79922a7-5f9d-4d90-8bb2-7233155654e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e11eeb5-04ce-4e6e-a885-dabc841d57c3', 'enforce_multipath': True} {{(pid=84206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:05:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-26808f5d-9ae7-4c30-a84f-25f71084475d req-fb9b40b0-d9da-4b21-8443-963d40dbb20d tempest-DeleteServersTestJSON-373016684 None] attachment_update completed successfully. Apr 30 11:05:00 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346" returned: 0 in 1.505s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:00 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346 Apr 30 11:05:00 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:01 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9bd77107-b8e5-46d5-bc46-2bce23530346" returned: 0 in 1.117s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "cinder-quobyte-9bd77107-b8e5-46d5-bc46-2bce23530346" released by "delete_volume" :: held 5.041s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:01 devstack cinder-volume[84206]: WARNING cinder.quota [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:05:01 devstack cinder-volume[84206]: WARNING cinder.quota [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Created reservations ['69895797-6522-4ef8-9d91-5719a824e191', 'e266927f-0583-4c5a-9594-c2ad98784ab3', '2791e526-222e-4c74-aeee-8a12777f9334', '616887fd-a5a9-4f30-9225-425c358cea9a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:01 devstack sudo[85260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:05:01 devstack sudo[85260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:02 devstack sudo[85260]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.894s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:02 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:02 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Deleted volume successfully. Apr 30 11:05:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de5b84fb-4af7-411f-a1dd-be1db59881fb tempest-VolumesAdminNegativeTest-12739629 None] Lock "cinder-9bd77107-b8e5-46d5-bc46-2bce23530346-delete_volume" released by "delete_volume" :: held 6.401s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:06 devstack sudo[85638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:05:06 devstack sudo[85638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:07 devstack sudo[85638]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.803s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:11 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=16,cinder:INSERT=4,cinder:DELETE=1,cinder:SELECT=11 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:12 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-bfd50ae3-15dc-4770-b894-0c6487854a8a req-380165e4-fbdf-4703-8c33-86dcfccaf5cc tempest-DeleteServersTestJSON-373016684 None] Terminate volume connection completed successfully. Apr 30 11:05:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-bfd50ae3-15dc-4770-b894-0c6487854a8a req-380165e4-fbdf-4703-8c33-86dcfccaf5cc tempest-DeleteServersTestJSON-373016684 None] Deleting attachment 3e11eeb5-04ce-4e6e-a885-dabc841d57c3. {{(pid=84206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "cinder-c79922a7-5f9d-4d90-8bb2-7233155654e1-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "cinder-c79922a7-5f9d-4d90-8bb2-7233155654e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "cinder-quobyte-c79922a7-5f9d-4d90-8bb2-7233155654e1" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "cinder-quobyte-c79922a7-5f9d-4d90-8bb2-7233155654e1" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1260a8-67a2-474a-8ba5-698aa39bfcb8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:18 devstack sudo[85718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 Apr 30 11:05:18 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:19 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1" returned: 0 in 0.889s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:19 devstack sudo[85728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1 Apr 30 11:05:19 devstack sudo[85728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:20 devstack sudo[85728]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c79922a7-5f9d-4d90-8bb2-7233155654e1" returned: 0 in 0.987s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "cinder-quobyte-c79922a7-5f9d-4d90-8bb2-7233155654e1" released by "delete_volume" :: held 1.947s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Created reservations ['ccb6f348-eb8f-40bb-89b5-bbff77ee73f0', 'f1cdc6cb-2943-4ce0-a912-7c7d69deea6f', 'ae073e2f-11e2-49e9-a245-b157ce8f9f82', '1799fa99-a7d8-4e8d-b2e6-f98ef5fdb388'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:20 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:05:20 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:21 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.931s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:21 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:05:21 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Deleted volume successfully. Apr 30 11:05:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d965b4ca-3c61-458b-8200-9e8ca939d552 tempest-DeleteServersTestJSON-373016684 None] Lock "cinder-c79922a7-5f9d-4d90-8bb2-7233155654e1-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:05:30 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=4,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:31 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:44 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:05:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Flow 'volume_create_manager' (28ca86b5-d9a1-424c-afa4-cdb2dd4e4c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb0fd19-ff15-4574-9d97-6ad3b9f941a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb0fd19-ff15-4574-9d97-6ad3b9f941a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-691203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2e7a73-2335-4685-bfaf-ed84b73305ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2165d79eb54440b4a8b6726b5f236866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:45Z,use_quota=True,user_id='50a3cda618f24e54bb1032ed50a8780f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b14b413-f044-44d2-8a16-8a4f324a2879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b14b413-f044-44d2-8a16-8a4f324a2879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b1b25f-3c96-4e72-bd11-275878660a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b1b25f-3c96-4e72-bd11-275878660a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2e7a73-2335-4685-bfaf-ed84b73305ff', 'volume_name': 'volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab208a2c-6513-47da-a579-0be3bc19c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab208a2c-6513-47da-a579-0be3bc19c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c701d1-68ac-4d08-8974-9204af425c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:45 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Volume 4d2e7a73-2335-4685-bfaf-ed84b73305ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff', 'volume_size': 1} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-691203349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2e7a73-2335-4685-bfaf-ed84b73305ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2165d79eb54440b4a8b6726b5f236866',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:45Z,use_quota=True,user_id='50a3cda618f24e54bb1032ed50a8780f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Creating volume 4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:45 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:45 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff 1073741824 Apr 30 11:05:45 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:45 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=1 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:05:46 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff 1073741824" returned: 0 in 1.267s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:46 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff Apr 30 11:05:46 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:47 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff" returned: 0 in 0.972s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.331s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c701d1-68ac-4d08-8974-9204af425c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca2626a-8607-44ec-8eb3-04ae968bf19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:47 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Volume volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff (4d2e7a73-2335-4685-bfaf-ed84b73305ff): created successfully Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca2626a-8607-44ec-8eb3-04ae968bf19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Flow 'volume_create_manager' (28ca86b5-d9a1-424c-afa4-cdb2dd4e4c5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-1956b5ea-2483-4cdc-9fb8-b7d1ce7bbfe9 req-fefe930b-2aad-45d1-9074-19242c244a1f tempest-VolumesSnapshotsTestJSON-103660508 None] Created volume successfully. Apr 30 11:05:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Creating offline snapshot f7a3ca65-eba2-4865-8e4f-132a06be6e32 of volume 4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:05:48 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53acb79c-6e18-4d65-b7e1-0b2f389ae2e1]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:48 devstack sudo[85920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff Apr 30 11:05:48 devstack sudo[85920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:50 devstack sudo[85920]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff" returned: 0 in 1.603s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:50 devstack sudo[85930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 1G Apr 30 11:05:50 devstack sudo[85930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:52 devstack sudo[85930]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 1G" returned: 0 in 1.895s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:52 devstack sudo[85988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 Apr 30 11:05:52 devstack sudo[85988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:53 devstack sudo[85988]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32" returned: 0 in 1.935s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:53 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 is being set with open permissions: ugo+rw Apr 30 11:05:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:54 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 Apr 30 11:05:54 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:55 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32" returned: 0 in 1.337s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:55 devstack sudo[86042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info Apr 30 11:05:55 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:56 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info" returned: 0 in 1.426s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:56 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info is being set with open permissions: ugo+rw Apr 30 11:05:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:56 devstack sudo[86059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info Apr 30 11:05:56 devstack sudo[86059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (4939685d-f7a1-4247-bd98-70ede7b9f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5498a8-1303-46ba-9ace-ed39988b2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5498a8-1303-46ba-9ace-ed39988b2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182523895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ae2e11-031a-43ab-9d3b-19bd80cd8e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:58Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e8b2b5-5b26-4e36-9e6e-5f958877ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e8b2b5-5b26-4e36-9e6e-5f958877ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0d1c6d-6c77-4612-97f0-77fd05c6cc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:58 devstack sudo[86059]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0d1c6d-6c77-4612-97f0-77fd05c6cc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ae2e11-031a-43ab-9d3b-19bd80cd8e5c', 'volume_name': 'volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb34579-4aec-4e8d-a36d-413397714ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fb34579-4aec-4e8d-a36d-413397714ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb489113-aa7d-4ef7-8b3a-61676214230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:05:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Volume 34ae2e11-031a-43ab-9d3b-19bd80cd8e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c', 'volume_size': 1} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.info" returned: 0 in 1.314s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.780s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182523895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ae2e11-031a-43ab-9d3b-19bd80cd8e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:05:58Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Creating volume 34ae2e11-031a-43ab-9d3b-19bd80cd8e5c {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:05:58 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:58 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c 1073741824 Apr 30 11:05:58 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-6157b4cc-3d64-4b2a-94db-1e832725f86e req-5c9c7715-8547-4838-a05b-2346470c70df tempest-VolumesSnapshotsTestJSON-103660508 None] Create snapshot completed successfully Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "cinder-f7a3ca65-eba2-4865-8e4f-132a06be6e32-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-f7a3ca65-eba2-4865-8e4f-132a06be6e32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "cinder-quobyte-f7a3ca65-eba2-4865-8e4f-132a06be6e32" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-f7a3ca65-eba2-4865-8e4f-132a06be6e32" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Deleting offline snapshot f7a3ca65-eba2-4865-8e4f-132a06be6e32 of volume 4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] snapshot_file for this snap is: volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d8d717-ddfa-40af-8ce4-b8145afcd21a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:59 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 Apr 30 11:05:59 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:05:59 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c 1073741824" returned: 0 in 1.274s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:05:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:05:59 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c Apr 30 11:05:59 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:00 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32" returned: 0 in 0.966s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5a4799-fb63-42f2-8cff-8687bc934d9e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:00 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff Apr 30 11:06:00 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:00 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" returned: 0 in 0.891s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb489113-aa7d-4ef7-8b3a-61676214230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625e3568-abdf-4fd6-8904-edd3b067fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:00 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Volume volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c (34ae2e11-031a-43ab-9d3b-19bd80cd8e5c): created successfully Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (625e3568-abdf-4fd6-8904-edd3b067fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (4939685d-f7a1-4247-bd98-70ede7b9f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a0a48283-4564-4215-8962-48f752774094 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:01 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff" returned: 0 in 1.036s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:01 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 Apr 30 11:06:01 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d476ccc-959c-4366-848c-0de6b2bbdee2 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" by "attach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d476ccc-959c-4366-848c-0de6b2bbdee2 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" acquired by "attach_volume" :: waited 0.043s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:01 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7d476ccc-959c-4366-848c-0de6b2bbdee2 tempest-VolumesActionsTest-1402307224 None] Attaching volume 34ae2e11-031a-43ab-9d3b-19bd80cd8e5c to instance ec5a94f6-8048-443e-b13f-29317060f791 at mountpoint /dev/vdb on host None. Apr 30 11:06:01 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7d476ccc-959c-4366-848c-0de6b2bbdee2 tempest-VolumesActionsTest-1402307224 None] Attach volume completed successfully. Apr 30 11:06:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d476ccc-959c-4366-848c-0de6b2bbdee2 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" released by "attach_volume" :: held 0.156s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:02 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32" returned: 0 in 1.492s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:02 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32 Apr 30 11:06:02 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Terminate volume connection completed successfully. Apr 30 11:06:03 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff.f7a3ca65-eba2-4865-8e4f-132a06be6e32" returned: 0 in 1.072s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" by "detach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-f7a3ca65-eba2-4865-8e4f-132a06be6e32" released by "_delete_snapshot" :: held 4.962s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" acquired by "detach_volume" :: waited 0.094s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" released by "delete_snapshot" :: held 5.048s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Detaching volume 34ae2e11-031a-43ab-9d3b-19bd80cd8e5c from instance ec5a94f6-8048-443e-b13f-29317060f791. Apr 30 11:06:04 devstack cinder-volume[84206]: WARNING cinder.quota [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:06:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Detach volume completed successfully. Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.quota [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Created reservations ['aed17b9f-ea9c-4c31-ab0d-88a4f0936828', 'e87a602f-a971-44ac-8ff9-7ed185b3c6f1', 'a3a9976d-9bd3-4e33-93cc-63181a93f361', '93179570-3111-4c41-bc7d-04790c40199a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-32d6378b-f21b-497e-a0fd-966b25f3745d tempest-VolumesActionsTest-173251412 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" released by "detach_volume" :: held 0.323s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Delete snapshot completed successfully. Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-fb5e7045-c02f-4d82-9bd3-f429d08e6e3d req-57e23b91-83b4-4d58-943c-a11035c53b07 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-f7a3ca65-eba2-4865-8e4f-132a06be6e32-delete_snapshot" released by "delete_snapshot" :: held 5.651s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-71281627-fb35-451b-9c09-052e993251eb tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" by "detach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-71281627-fb35-451b-9c09-052e993251eb tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-71281627-fb35-451b-9c09-052e993251eb tempest-VolumesActionsTest-1402307224 None] Volume detach called, but volume not attached. Apr 30 11:06:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-71281627-fb35-451b-9c09-052e993251eb tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-detach_volume" released by "detach_volume" :: held 0.069s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "cinder-4d2e7a73-2335-4685-bfaf-ed84b73305ff-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-4d2e7a73-2335-4685-bfaf-ed84b73305ff-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d90d46-e628-41c1-b376-6117f4f5a1b3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:05 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff Apr 30 11:06:05 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-quobyte-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-quobyte-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" acquired by "delete_volume" :: waited 0.059s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2e308-9270-4284-9b66-9be049c9b695]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:06 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c Apr 30 11:06:06 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:07 devstack sudo[86172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:07 devstack sudo[86172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:07 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff" returned: 0 in 2.243s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:07 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff Apr 30 11:06:07 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:08 devstack sudo[86172]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.169s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:08 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" returned: 0 in 1.942s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:08 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c Apr 30 11:06:08 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:08 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d2e7a73-2335-4685-bfaf-ed84b73305ff" returned: 0 in 1.234s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:08 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-quobyte-4d2e7a73-2335-4685-bfaf-ed84b73305ff" released by "delete_volume" :: held 3.679s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.quota [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Created reservations ['7ff54ff9-4161-43d9-ace6-8c495414eba6', 'acdef048-783a-4a71-987f-a44a6afa2dc0', '2b8501c7-a524-4282-bd7b-cc8315e3f022', 'c33f2427-8eea-4032-9f00-260ef26e4fcb'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:09 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:09 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:09 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" returned: 0 in 1.020s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-quobyte-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c" released by "delete_volume" :: held 3.156s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Created reservations ['8cd0fb7f-7725-41a9-800e-68cb94067d1c', '1c2bae59-753c-4e6f-905a-631cbc719774', '85a256a4-7110-462d-8804-6b57452d33b4', '4ffe7011-5427-4f96-a729-86008699b40f'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:09 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:09 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:10 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.329s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:10 devstack cinder-volume[84206]: DEBUG cinder.manager [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Deleted volume successfully. Apr 30 11:06:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-9ed898bc-4abf-4da5-ad96-6788d521ba0a req-dfd6292b-8a40-44a3-bb77-ab430021b7e5 tempest-VolumesSnapshotsTestJSON-103660508 None] Lock "cinder-4d2e7a73-2335-4685-bfaf-ed84b73305ff-delete_volume" released by "delete_volume" :: held 5.427s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:11 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.317s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:11 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Deleted volume successfully. Apr 30 11:06:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-efbb0984-ea19-440a-9597-aa1fc52c92d9 tempest-VolumesActionsTest-1402307224 None] Lock "cinder-34ae2e11-031a-43ab-9d3b-19bd80cd8e5c-delete_volume" released by "delete_volume" :: held 5.028s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Flow 'volume_create_manager' (c86435fa-0ead-4a6f-9075-af95f53df7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2fee6e-c316-4f04-993d-e0f0ea79328f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2fee6e-c316-4f04-993d-e0f0ea79328f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-20984302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbb22a-cce9-4dbb-923e-dae67be8dff2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f7d4f38b31d48759f37ba151b063db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:15Z,use_quota=True,user_id='ff542bdc3b9c42f69f9564fa7a0260ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d9b18-38c7-4a17-99ba-9cce0b3298fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d9b18-38c7-4a17-99ba-9cce0b3298fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdadc7b-2509-48c4-9683-b176fea4141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdadc7b-2509-48c4-9683-b176fea4141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07bbb22a-cce9-4dbb-923e-dae67be8dff2', 'volume_name': 'volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a468e56-6ae7-4bd9-a14f-679013c59ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a468e56-6ae7-4bd9-a14f-679013c59ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff72596-5974-4e10-9b6d-01d2ac49d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:14 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Volume 07bbb22a-cce9-4dbb-923e-dae67be8dff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2', 'volume_size': 1} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-20984302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07bbb22a-cce9-4dbb-923e-dae67be8dff2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9f7d4f38b31d48759f37ba151b063db9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:15Z,use_quota=True,user_id='ff542bdc3b9c42f69f9564fa7a0260ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Creating volume 07bbb22a-cce9-4dbb-923e-dae67be8dff2 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:14 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:14 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 1073741824 Apr 30 11:06:14 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:15 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 1073741824" returned: 0 in 1.210s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:16 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 Apr 30 11:06:16 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:16 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2" returned: 0 in 0.683s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff72596-5974-4e10-9b6d-01d2ac49d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0668f8-05be-4df0-9334-1fa44a553523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:16 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Volume volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 (07bbb22a-cce9-4dbb-923e-dae67be8dff2): created successfully Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0668f8-05be-4df0-9334-1fa44a553523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Flow 'volume_create_manager' (c86435fa-0ead-4a6f-9075-af95f53df7d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:16 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-c524fc8c-f728-4216-a4ba-5dee37ff2c5e req-eb6561d3-72f8-4167-8e8f-13c7edc59a5e tempest-VolumesGetTestJSON-1596667807 None] Created volume successfully. Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Acquiring lock "cinder-07bbb22a-cce9-4dbb-923e-dae67be8dff2-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "cinder-07bbb22a-cce9-4dbb-923e-dae67be8dff2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Acquiring lock "cinder-quobyte-07bbb22a-cce9-4dbb-923e-dae67be8dff2" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "cinder-quobyte-07bbb22a-cce9-4dbb-923e-dae67be8dff2" acquired by "delete_volume" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb70e23-26f0-493d-aa18-6c1a6315c05e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:17 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 Apr 30 11:06:17 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (2584c8dd-9671-4849-b1c5-ff9ab51873aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725e8036-83cc-4544-89a2-f07a4472732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725e8036-83cc-4544-89a2-f07a4472732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374578435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2850fe70-9406-407c-b89d-ec369b2fddc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:18Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538e9793-204f-435f-8df9-6b8a4c433506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538e9793-204f-435f-8df9-6b8a4c433506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0982476b-97c6-4e43-a370-6c6c49d0ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0982476b-97c6-4e43-a370-6c6c49d0ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2850fe70-9406-407c-b89d-ec369b2fddc7', 'volume_name': 'volume-2850fe70-9406-407c-b89d-ec369b2fddc7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edd7558-4d62-45fe-82c8-4b39fe74cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edd7558-4d62-45fe-82c8-4b39fe74cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678b6874-9a00-470b-bda5-471186388687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:18 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Volume 2850fe70-9406-407c-b89d-ec369b2fddc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2850fe70-9406-407c-b89d-ec369b2fddc7', 'volume_size': 1} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374578435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2850fe70-9406-407c-b89d-ec369b2fddc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:18Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Creating volume 2850fe70-9406-407c-b89d-ec369b2fddc7 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:18 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:18 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 1073741824 Apr 30 11:06:18 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:18 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2" returned: 0 in 1.271s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:18 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2 Apr 30 11:06:18 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:19 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 1073741824" returned: 0 in 1.247s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:19 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 Apr 30 11:06:19 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:19 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-07bbb22a-cce9-4dbb-923e-dae67be8dff2" returned: 0 in 0.868s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "cinder-quobyte-07bbb22a-cce9-4dbb-923e-dae67be8dff2" released by "delete_volume" :: held 2.226s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG cinder.quota [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Created reservations ['dca86d57-8427-4083-9619-0cb328765c74', 'a5d85d00-a182-486b-9822-76489970a602', '9d8ff49d-6c45-46e6-ade5-d486dde67cac', '92e69e4b-c8a8-4de8-894b-b9c9e53f92db'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:19 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:19 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:20 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7" returned: 0 in 1.002s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678b6874-9a00-470b-bda5-471186388687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2850fe70-9406-407c-b89d-ec369b2fddc7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7793693-50be-42b8-b6b0-5a7644b2b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.663s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.manager [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Deleted volume successfully. Apr 30 11:06:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Volume volume-2850fe70-9406-407c-b89d-ec369b2fddc7 (2850fe70-9406-407c-b89d-ec369b2fddc7): created successfully Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7793693-50be-42b8-b6b0-5a7644b2b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (2584c8dd-9671-4849-b1c5-ff9ab51873aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-0faf796a-90ba-40bf-acb5-cb964017c2ff req-dbefb9a6-db45-436b-bf2f-db59af962dd6 tempest-VolumesGetTestJSON-1596667807 None] Lock "cinder-07bbb22a-cce9-4dbb-923e-dae67be8dff2-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e1bbf2f6-9f2b-40b6-a966-7def48024a55 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Flow 'volume_create_manager' (85e5175c-27ed-45ef-a95c-90545e169d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f701b09e-7248-48b9-9a46-7e65022b7f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f701b09e-7248-48b9-9a46-7e65022b7f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-9405735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c53cf2-c4be-43bb-b41b-b9d44ea2ad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196b6d785d2d4446a1f1f7c4d1dbc153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:21Z,use_quota=True,user_id='9a18e5f99a5445d09a2b968bbaa0708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734d9e47-086d-4a50-8995-fc5194a0ed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (734d9e47-086d-4a50-8995-fc5194a0ed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51779524-f18c-44c8-bd7b-517de3e8f0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51779524-f18c-44c8-bd7b-517de3e8f0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c53cf2-c4be-43bb-b41b-b9d44ea2ad95', 'volume_name': 'volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987e492b-50cc-4e88-ac55-8f921835d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987e492b-50cc-4e88-ac55-8f921835d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b530f-2db1-45b9-8de1-a8803cfc6d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Volume 87c53cf2-c4be-43bb-b41b-b9d44ea2ad95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95', 'volume_size': 1} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-9405735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c53cf2-c4be-43bb-b41b-b9d44ea2ad95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196b6d785d2d4446a1f1f7c4d1dbc153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:21Z,use_quota=True,user_id='9a18e5f99a5445d09a2b968bbaa0708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Creating volume 87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:20 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:20 devstack sudo[86426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 1073741824 Apr 30 11:06:20 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-2850fe70-9406-407c-b89d-ec369b2fddc7-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "cinder-2850fe70-9406-407c-b89d-ec369b2fddc7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-quobyte-2850fe70-9406-407c-b89d-ec369b2fddc7" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-2850fe70-9406-407c-b89d-ec369b2fddc7" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9128bc08-74e4-4203-b29e-78cbd92f8d23]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:21 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 1073741824" returned: 0 in 1.142s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:21 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 Apr 30 11:06:21 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:21 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 Apr 30 11:06:21 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:22 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7" returned: 0 in 0.892s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:22 devstack sudo[86441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7 Apr 30 11:06:22 devstack sudo[86441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:22 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" returned: 0 in 0.893s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986b530f-2db1-45b9-8de1-a8803cfc6d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8057389a-3850-4db7-91bb-b9d1bf8840a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:22 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Volume volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 (87c53cf2-c4be-43bb-b41b-b9d44ea2ad95): created successfully Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8057389a-3850-4db7-91bb-b9d1bf8840a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Flow 'volume_create_manager' (85e5175c-27ed-45ef-a95c-90545e169d02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3236ac45-cdab-4946-869c-635386aa77a0 tempest-ServersNegativeTestJSON-1587884300 None] Created volume successfully. Apr 30 11:06:23 devstack sudo[86441]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2850fe70-9406-407c-b89d-ec369b2fddc7" returned: 0 in 0.860s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-2850fe70-9406-407c-b89d-ec369b2fddc7" released by "delete_volume" :: held 1.798s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Created reservations ['55167f98-0075-452b-92aa-f62e1354fdbc', '750728f5-cd43-45fd-a977-3d80945bbd98', '11ece528-e7a5-41a1-a5bf-06d432ade983', 'adddfc35-2d64-4f8e-bf5d-023ad3b40b56'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:23 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:23 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:24 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:24 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Deleted volume successfully. Apr 30 11:06:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9638948d-b91a-4985-ac71-e7e6494301d4 tempest-VolumesActionsTest-173251412 None] Lock "cinder-2850fe70-9406-407c-b89d-ec369b2fddc7-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (ddee3b36-7f46-4832-9e20-3dcef16f0ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615a8ee7-fad9-437d-97ce-dbd309833c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615a8ee7-fad9-437d-97ce-dbd309833c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1586246008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba928fc-b75b-4b36-8bca-57fc22543071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:25Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1849c7-1884-4bde-9e16-19e5c8370bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c1849c7-1884-4bde-9e16-19e5c8370bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567855c-6033-41a2-97ea-7f67a431cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567855c-6033-41a2-97ea-7f67a431cee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba928fc-b75b-4b36-8bca-57fc22543071', 'volume_name': 'volume-6ba928fc-b75b-4b36-8bca-57fc22543071', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f9478a-229f-4b74-a98d-9fb4467f5aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f9478a-229f-4b74-a98d-9fb4467f5aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6fe584-a39e-42e5-8a1c-df38de75a2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:25 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Volume 6ba928fc-b75b-4b36-8bca-57fc22543071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba928fc-b75b-4b36-8bca-57fc22543071', 'volume_size': 1} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1586246008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba928fc-b75b-4b36-8bca-57fc22543071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:25Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Creating volume 6ba928fc-b75b-4b36-8bca-57fc22543071 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:25 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:25 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 1073741824 Apr 30 11:06:25 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:26 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (66e771e1-8cc9-4c43-b057-d8e4b5cb55e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d7b8ad-400a-4608-9504-34a4b2cbc155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 1073741824" returned: 0 in 1.506s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d7b8ad-400a-4608-9504-34a4b2cbc155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-859718331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23bf096-7335-49b4-b193-1f960a03ddd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:27Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a502ec-e35e-4697-9797-6fd605e3c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13a502ec-e35e-4697-9797-6fd605e3c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699c759a-2af5-45b2-a053-4471b5eabb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699c759a-2af5-45b2-a053-4471b5eabb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23bf096-7335-49b4-b193-1f960a03ddd9', 'volume_name': 'volume-b23bf096-7335-49b4-b193-1f960a03ddd9', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c9e6ce-f692-4950-803c-808fc9336d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c9e6ce-f692-4950-803c-808fc9336d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c9388-13c3-43b7-b64c-d407c5326abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Volume b23bf096-7335-49b4-b193-1f960a03ddd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23bf096-7335-49b4-b193-1f960a03ddd9', 'volume_size': 1} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:26 devstack sudo[86478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 Apr 30 11:06:26 devstack sudo[86478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Flow 'volume_create_manager' (b6b1bf22-4af2-4c1f-aa46-da3f50ea2fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976e1026-3ef6-4a7d-aba5-6ef8821ded63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976e1026-3ef6-4a7d-aba5-6ef8821ded63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-612180861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead52e00-01aa-44f5-84d0-c59141c443bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196b6d785d2d4446a1f1f7c4d1dbc153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:27Z,use_quota=True,user_id='9a18e5f99a5445d09a2b968bbaa0708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3188f1-9524-4aa9-9fcc-5904d94b615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3188f1-9524-4aa9-9fcc-5904d94b615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9849f-3d17-404d-be63-12d1a9e497d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b9849f-3d17-404d-be63-12d1a9e497d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ead52e00-01aa-44f5-84d0-c59141c443bc', 'volume_name': 'volume-ead52e00-01aa-44f5-84d0-c59141c443bc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63185d91-7bf9-48fb-ad3a-b7af0f65f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63185d91-7bf9-48fb-ad3a-b7af0f65f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3d1d86-c8ad-4fe8-8873-c784d83f3af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Volume ead52e00-01aa-44f5-84d0-c59141c443bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ead52e00-01aa-44f5-84d0-c59141c443bc', 'volume_size': 1} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:27 devstack sudo[86478]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071" returned: 0 in 0.638s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-859718331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b23bf096-7335-49b4-b193-1f960a03ddd9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:27Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Creating volume b23bf096-7335-49b4-b193-1f960a03ddd9 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:27 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:27 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 1073741824 Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6fe584-a39e-42e5-8a1c-df38de75a2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba928fc-b75b-4b36-8bca-57fc22543071', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba669a0c-a8a9-44bd-ba1c-7f8d8136ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Volume volume-6ba928fc-b75b-4b36-8bca-57fc22543071 (6ba928fc-b75b-4b36-8bca-57fc22543071): created successfully Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba669a0c-a8a9-44bd-ba1c-7f8d8136ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (ddee3b36-7f46-4832-9e20-3dcef16f0ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7b30a674-5399-41f2-b191-da81482ae4e8 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-6ba928fc-b75b-4b36-8bca-57fc22543071-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "cinder-6ba928fc-b75b-4b36-8bca-57fc22543071-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-quobyte-6ba928fc-b75b-4b36-8bca-57fc22543071" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-6ba928fc-b75b-4b36-8bca-57fc22543071" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1139dc-caea-42f0-8a59-0e8ec7dd82b4]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:28 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 1073741824" returned: 0 in 1.108s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:28 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 Apr 30 11:06:28 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:28 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 Apr 30 11:06:28 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:29 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9" returned: 0 in 0.643s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:29 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.271s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-612180861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ead52e00-01aa-44f5-84d0-c59141c443bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196b6d785d2d4446a1f1f7c4d1dbc153',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:27Z,use_quota=True,user_id='9a18e5f99a5445d09a2b968bbaa0708c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Creating volume ead52e00-01aa-44f5-84d0-c59141c443bc {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:29 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071" returned: 0 in 0.826s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:29 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc 1073741824 Apr 30 11:06:29 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b94c9388-13c3-43b7-b64c-d407c5326abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23bf096-7335-49b4-b193-1f960a03ddd9', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effd8106-7f95-4dde-9ad8-491c8521b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:29 devstack sudo[86520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071 Apr 30 11:06:29 devstack sudo[86520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:29 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Volume volume-b23bf096-7335-49b4-b193-1f960a03ddd9 (b23bf096-7335-49b4-b193-1f960a03ddd9): created successfully Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (effd8106-7f95-4dde-9ad8-491c8521b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (66e771e1-8cc9-4c43-b057-d8e4b5cb55e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-84b7a0b1-a2a0-478e-924c-86a6b3db1270 tempest-VolumesTestJSON-1383710722 None] Created volume successfully. Apr 30 11:06:30 devstack sudo[86520]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6ba928fc-b75b-4b36-8bca-57fc22543071" returned: 0 in 0.738s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-6ba928fc-b75b-4b36-8bca-57fc22543071" released by "delete_volume" :: held 1.612s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Created reservations ['2992c192-af83-413e-ae24-e699f84bfc88', '4eb239f4-32f1-4f43-b41b-28e19f39ae83', '04396f61-50ab-4886-89d3-c688e2fa5058', '09e6ed73-3c7f-4de8-9925-3d470cbce160'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:30 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc 1073741824" returned: 0 in 0.890s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:30 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc Apr 30 11:06:30 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:30 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:30 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=70,cinder:SELECT=62,cinder:INSERT=22,cinder:DELETE=5 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (65617305-8f07-486b-8dfa-a068a2b204d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824d0b6-2c5f-4786-a30f-96a79dc2bc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3824d0b6-2c5f-4786-a30f-96a79dc2bc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550604281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bfcbcf-0855-413a-b066-1eba2e9f05d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:30Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97329c30-867c-4c30-918d-d7fd82be7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97329c30-867c-4c30-918d-d7fd82be7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eed95a7-b807-4552-b9c2-a08c947862c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eed95a7-b807-4552-b9c2-a08c947862c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15bfcbcf-0855-413a-b066-1eba2e9f05d6', 'volume_name': 'volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaede22-e31a-4c0b-9d4f-16de0cf02bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaede22-e31a-4c0b-9d4f-16de0cf02bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9f3791-ee81-454e-95e9-e69133f87487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:30 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Volume 15bfcbcf-0855-413a-b066-1eba2e9f05d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6', 'volume_size': 1} Apr 30 11:06:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:31 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc" returned: 0 in 0.746s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-550604281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bfcbcf-0855-413a-b066-1eba2e9f05d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:30Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Creating volume 15bfcbcf-0855-413a-b066-1eba2e9f05d6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:31 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:31 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Deleted volume successfully. Apr 30 11:06:31 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 1073741824 Apr 30 11:06:31 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca3d1d86-c8ad-4fe8-8873-c784d83f3af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ead52e00-01aa-44f5-84d0-c59141c443bc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb42c94e-06e9-49c4-a7cc-c653667026da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-df45cc3d-c016-4d21-8980-3ab49dbc507d tempest-VolumesActionsTest-173251412 None] Lock "cinder-6ba928fc-b75b-4b36-8bca-57fc22543071-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Volume volume-ead52e00-01aa-44f5-84d0-c59141c443bc (ead52e00-01aa-44f5-84d0-c59141c443bc): created successfully Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb42c94e-06e9-49c4-a7cc-c653667026da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Flow 'volume_create_manager' (b6b1bf22-4af2-4c1f-aa46-da3f50ea2fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2fe8136f-4125-457d-af26-d41af3afdb2a tempest-ServersNegativeTestJSON-1587884300 None] Created volume successfully. Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (43c9159b-5a97-4d87-81fd-c51d23be052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b70e1d-8a5f-4ea0-a49b-a8bf1dd5792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b70e1d-8a5f-4ea0-a49b-a8bf1dd5792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-240638435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a0862-ba7e-4ec6-af99-6892df2b3969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:31Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bed410d-a349-4a44-a102-526046759d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bed410d-a349-4a44-a102-526046759d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feca69e-a7c3-4afa-b955-19015ea81c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9feca69e-a7c3-4afa-b955-19015ea81c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271a0862-ba7e-4ec6-af99-6892df2b3969', 'volume_name': 'volume-271a0862-ba7e-4ec6-af99-6892df2b3969', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0d472a-5eed-4ed1-87ff-aea398d9867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c0d472a-5eed-4ed1-87ff-aea398d9867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a53b93-db16-46ee-b754-394d44b76391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Volume 271a0862-ba7e-4ec6-af99-6892df2b3969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271a0862-ba7e-4ec6-af99-6892df2b3969', 'volume_size': 1} Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:31 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 1073741824" returned: 0 in 0.858s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:32 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 Apr 30 11:06:32 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:32 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6" returned: 0 in 0.641s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-240638435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a0862-ba7e-4ec6-af99-6892df2b3969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:31Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Creating volume 271a0862-ba7e-4ec6-af99-6892df2b3969 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:32 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:32 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 1073741824 Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9f3791-ee81-454e-95e9-e69133f87487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:32 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d36cb2-9ccf-468a-9c23-9ef6c1d41a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Volume volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 (15bfcbcf-0855-413a-b066-1eba2e9f05d6): created successfully Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d36cb2-9ccf-468a-9c23-9ef6c1d41a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (65617305-8f07-486b-8dfa-a068a2b204d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9ef223ba-a53c-4f2d-b5b0-80175c936d51 tempest-VolumesTestJSON-1383710722 None] Created volume successfully. Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "cinder-ead52e00-01aa-44f5-84d0-c59141c443bc-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-ead52e00-01aa-44f5-84d0-c59141c443bc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "cinder-quobyte-ead52e00-01aa-44f5-84d0-c59141c443bc" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-quobyte-ead52e00-01aa-44f5-84d0-c59141c443bc" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c5ec0-334e-4071-8337-2b839267bdc3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:33 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc Apr 30 11:06:33 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:33 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 1073741824" returned: 0 in 0.934s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:33 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 Apr 30 11:06:33 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:33 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc" returned: 0 in 0.764s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:33 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc Apr 30 11:06:33 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (d1bb431b-c670-4e90-b19d-cc441b5329e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1acacec-4cd2-4cfb-849d-8d86b2999499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1acacec-4cd2-4cfb-849d-8d86b2999499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1215185690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:34Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b8b344-2491-46dd-9c50-d276832b1522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b8b344-2491-46dd-9c50-d276832b1522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639e094f-c949-40f3-bdc7-cc1c48310851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639e094f-c949-40f3-bdc7-cc1c48310851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5', 'volume_name': 'volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80c2f2-2593-4336-9846-382908f31d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e80c2f2-2593-4336-9846-382908f31d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55034cbe-3cdd-4e9b-8fbd-2c4eacc83859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Volume c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5', 'volume_size': 1} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969" returned: 0 in 0.667s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1215185690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='adc0a3573e9543c1bea8fe4a1c65193a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:34Z,use_quota=True,user_id='eae9512871ce4d198fb727aed18ee2ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Creating volume c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:34 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a53b93-db16-46ee-b754-394d44b76391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271a0862-ba7e-4ec6-af99-6892df2b3969', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack sudo[86564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 1073741824 Apr 30 11:06:34 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632595a7-7ddf-4220-876e-0993fbbfd983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:34 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Volume volume-271a0862-ba7e-4ec6-af99-6892df2b3969 (271a0862-ba7e-4ec6-af99-6892df2b3969): created successfully Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632595a7-7ddf-4220-876e-0993fbbfd983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (43c9159b-5a97-4d87-81fd-c51d23be052d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-01979fea-974b-45e2-a1b7-c6b2bf207e08 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:34 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ead52e00-01aa-44f5-84d0-c59141c443bc" returned: 0 in 0.730s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-quobyte-ead52e00-01aa-44f5-84d0-c59141c443bc" released by "delete_volume" :: held 1.538s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Created reservations ['f66fe208-e5c6-477b-bd13-2d63a459c934', '9453a0ad-19d5-4ddf-aa08-c654beee1247', 'eb8992c3-e17c-4fb7-a889-3c5b586d92df', '8e913ad8-7cc2-47e8-bcc3-b4c57f0f4b4a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:34 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:34 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-271a0862-ba7e-4ec6-af99-6892df2b3969-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "cinder-271a0862-ba7e-4ec6-af99-6892df2b3969-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-quobyte-271a0862-ba7e-4ec6-af99-6892df2b3969" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-271a0862-ba7e-4ec6-af99-6892df2b3969" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b21f3f9-f673-4bc7-af7a-09e8143ea2e7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:34 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 Apr 30 11:06:34 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "cinder-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "cinder-quobyte-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-quobyte-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:35 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 1073741824" returned: 0 in 1.022s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3757f71-b11d-4e49-a4da-bec22f9142f2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:35 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.858s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:35 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 Apr 30 11:06:35 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Deleted volume successfully. Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e019f420-8dd5-4552-a554-2c24e9aca710 tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-ead52e00-01aa-44f5-84d0-c59141c443bc-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:35 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 Apr 30 11:06:35 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:35 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969" returned: 0 in 1.047s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:35 devstack sudo[86582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969 Apr 30 11:06:35 devstack sudo[86582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:36 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" returned: 0 in 0.894s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55034cbe-3cdd-4e9b-8fbd-2c4eacc83859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75450388-6089-4240-9bab-90da43699cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:36 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Volume volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 (c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5): created successfully Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75450388-6089-4240-9bab-90da43699cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Flow 'volume_create_manager' (d1bb431b-c670-4e90-b19d-cc441b5329e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-714e65da-efe5-4678-aa17-0c55e1b8a707 tempest-VolumesTestJSON-1383710722 None] Created volume successfully. Apr 30 11:06:36 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" returned: 0 in 1.100s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:36 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95 Apr 30 11:06:36 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:36 devstack sudo[86582]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-271a0862-ba7e-4ec6-af99-6892df2b3969" returned: 0 in 0.760s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-271a0862-ba7e-4ec6-af99-6892df2b3969" released by "delete_volume" :: held 1.877s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Created reservations ['ea382976-87f4-46a2-9a7d-d3365d1ed8a2', '2df3afc4-b8c0-496e-a7ee-e7d584284697', '95c4f88c-98c3-4833-8928-48b546f283e0', '93fe4e7b-ad9a-4d75-bbec-9fe529b8ac53'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:37 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:37 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Flow 'volume_create_manager' (5aa91c2c-e887-4673-adf4-c6c44bf80b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67699152-8f02-46c6-9f0a-6ca1ff0f467a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67699152-8f02-46c6-9f0a-6ca1ff0f467a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:37Z,deleted=False,deleted_at=None,display_description='',display_name='9a78e1d9-e1e0-485d-be85-3d3fa3f96b11-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ac6f56-4252-42a1-a26e-1bd60a19b520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194b58baa879465c826ef22634233cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:37Z,use_quota=True,user_id='ecdab2bdf85b474a88581eac50d7527a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7c29b-1882-4fbf-a93c-12a00616fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c7c29b-1882-4fbf-a93c-12a00616fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313343c-0115-4d21-a479-fa392b61725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b313343c-0115-4d21-a479-fa392b61725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ac6f56-4252-42a1-a26e-1bd60a19b520', 'volume_name': 'volume-63ac6f56-4252-42a1-a26e-1bd60a19b520', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f0537-e509-4323-91ce-78b9face715e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c4f0537-e509-4323-91ce-78b9face715e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f4ed19-1fab-48a6-9553-b7b765dfa429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume 63ac6f56-4252-42a1-a26e-1bd60a19b520: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ac6f56-4252-42a1-a26e-1bd60a19b520', 'volume_size': 1} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:37Z,deleted=False,deleted_at=None,display_description='',display_name='9a78e1d9-e1e0-485d-be85-3d3fa3f96b11-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ac6f56-4252-42a1-a26e-1bd60a19b520,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194b58baa879465c826ef22634233cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:37Z,use_quota=True,user_id='ecdab2bdf85b474a88581eac50d7527a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Creating volume 63ac6f56-4252-42a1-a26e-1bd60a19b520 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:37 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:37 devstack sudo[86627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 1073741824 Apr 30 11:06:37 devstack sudo[86627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:37 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" returned: 0 in 1.411s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-quobyte-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95" released by "delete_volume" :: held 2.646s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (626fef1e-aa6d-4984-afba-b1cf0b2fdd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06eda7a2-ce14-4c0f-82a5-7494eaabb428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06eda7a2-ce14-4c0f-82a5-7494eaabb428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1123451747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d10dc8-7b56-40cc-b7dd-38da634e9e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:38Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d03d2a-49f9-4e9f-9308-c31f708768c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d03d2a-49f9-4e9f-9308-c31f708768c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440ddd96-9b94-46c1-a91d-a86147570c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440ddd96-9b94-46c1-a91d-a86147570c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73d10dc8-7b56-40cc-b7dd-38da634e9e92', 'volume_name': 'volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0572c4c-d9b4-4d92-a129-24d8f2b68abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0572c4c-d9b4-4d92-a129-24d8f2b68abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dbb973-d78e-4f8f-8028-5dd49246e6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Volume 73d10dc8-7b56-40cc-b7dd-38da634e9e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92', 'volume_size': 1} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Created reservations ['ae072fff-2cbc-4aaf-ab8e-feb7faa49fb5', 'caa3248d-c671-4911-89b5-6bd8272e7dd5', '23d32174-9200-4861-a8de-12c05d00f775', '07f90dee-4d10-4fb8-8e7e-e0068e66f01e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:38 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:38 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:38 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.468s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Deleted volume successfully. Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b04af0c8-2045-4ba1-b599-d2b8f54abf12 tempest-VolumesActionsTest-173251412 None] Lock "cinder-271a0862-ba7e-4ec6-af99-6892df2b3969-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:38 devstack sudo[86627]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 1073741824" returned: 0 in 1.245s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:38 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 Apr 30 11:06:38 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:39 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.873s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Deleted volume successfully. Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ada50511-b0d9-4fe9-a956-26ad5d8250fc tempest-ServersNegativeTestJSON-1587884300 None] Lock "cinder-87c53cf2-c4be-43bb-b41b-b9d44ea2ad95-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-quobyte-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" acquired by "delete_volume" :: waited 0.042s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9e03f6-40d7-478b-943b-c8a0dea15340]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:39 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 Apr 30 11:06:39 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:39 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520" returned: 0 in 1.069s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] <== create_volume: return (2435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.439s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1123451747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73d10dc8-7b56-40cc-b7dd-38da634e9e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:38Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Creating volume 73d10dc8-7b56-40cc-b7dd-38da634e9e92 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:39 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:40 devstack sudo[86649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 1073741824 Apr 30 11:06:40 devstack sudo[86649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f4ed19-1fab-48a6-9553-b7b765dfa429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ac6f56-4252-42a1-a26e-1bd60a19b520', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81513fe1-789a-4a32-93a7-4954d4a5709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:40 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 (63ac6f56-4252-42a1-a26e-1bd60a19b520): created successfully Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81513fe1-789a-4a32-93a7-4954d4a5709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Flow 'volume_create_manager' (5aa91c2c-e887-4673-adf4-c6c44bf80b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-05481f66-ad3e-42fd-b94c-a65209df065a tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Created volume successfully. Apr 30 11:06:40 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" returned: 0 in 1.277s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:40 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5 Apr 30 11:06:40 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:41 devstack sudo[86649]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 1073741824" returned: 0 in 1.545s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:41 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 Apr 30 11:06:41 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:41 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" returned: 0 in 0.850s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5" released by "delete_volume" :: held 2.221s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Created reservations ['cdcd90e3-5271-4b78-a64c-f58bad4f2788', '587383f9-e9bd-401a-b5cb-eed4d7cb4465', '165dd057-010b-4fc8-b594-d99353f298ea', '4d59940c-8b6c-44e0-ae9a-b46772d25652'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:41 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:41 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:42 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92" returned: 0 in 0.706s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.286s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7dbb973-d78e-4f8f-8028-5dd49246e6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e006136-5f7b-4070-8ea4-580511cc7b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94937ff-45e5-46ed-982c-175679544122]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:42 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Volume volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 (73d10dc8-7b56-40cc-b7dd-38da634e9e92): created successfully Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e006136-5f7b-4070-8ea4-580511cc7b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (626fef1e-aa6d-4984-afba-b1cf0b2fdd29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ba9de03b-d477-40c1-896d-d2d20a970766 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:42 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 Apr 30 11:06:42 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:42 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.768s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Deleted volume successfully. Apr 30 11:06:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce7ead5-941e-4d4d-a554-cc9fb2b9ce56 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-c34e51cb-d8a1-4a15-9bbb-7deb3e18b3a5-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-15bfcbcf-0855-413a-b066-1eba2e9f05d6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-15bfcbcf-0855-413a-b066-1eba2e9f05d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-quobyte-15bfcbcf-0855-413a-b066-1eba2e9f05d6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-15bfcbcf-0855-413a-b066-1eba2e9f05d6" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a7ebc3-5827-4e45-8299-0f18aa95ada5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:43 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520" returned: 0 in 0.852s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085', 'name': 'volume-63ac6f56-4252-42a1-a26e-1bd60a19b520', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20a22169-592c-44f3-ac2e-944d571ab02c', 'enforce_multipath': True} {{(pid=84206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:06:43 devstack sudo[86721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 Apr 30 11:06:43 devstack sudo[86721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-8ec82cfd-3cff-4228-9b44-5867ad1c26ea req-e7174067-b29a-4b1d-87f6-f2dec133a4d2 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] attachment_update completed successfully. Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-73d10dc8-7b56-40cc-b7dd-38da634e9e92-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "cinder-73d10dc8-7b56-40cc-b7dd-38da634e9e92-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Acquiring lock "cinder-quobyte-73d10dc8-7b56-40cc-b7dd-38da634e9e92" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-73d10dc8-7b56-40cc-b7dd-38da634e9e92" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb78f812-5107-431f-99d4-3340d19da6df]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:43 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 Apr 30 11:06:43 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:43 devstack sudo[86721]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6" returned: 0 in 0.791s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:43 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6 Apr 30 11:06:43 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:44 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92" returned: 0 in 0.881s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:44 devstack sudo[86735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92 Apr 30 11:06:44 devstack sudo[86735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:44 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-15bfcbcf-0855-413a-b066-1eba2e9f05d6" returned: 0 in 0.708s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-15bfcbcf-0855-413a-b066-1eba2e9f05d6" released by "delete_volume" :: held 1.538s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Created reservations ['813d45e1-48b5-45cb-8123-7d8f3057fedc', '2383ab90-2bc5-450a-aae9-5c384e2eee2e', 'abf1f2d0-304b-4ad5-af81-bb856006757c', '8514567a-f172-4a70-a620-00cd3927c48a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:44 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:44 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:45 devstack sudo[86735]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-73d10dc8-7b56-40cc-b7dd-38da634e9e92" returned: 0 in 0.668s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "cinder-quobyte-73d10dc8-7b56-40cc-b7dd-38da634e9e92" released by "delete_volume" :: held 1.590s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Created reservations ['95c8d261-1dd9-45a3-bafa-83831e13496b', 'f86fb29a-7380-490d-9504-6291482b6f13', '050144fc-9791-4945-94c7-85958c689e09', '8afb8e9c-da4b-40e7-bc40-dc9d8d53abf5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:45 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:45 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-b23bf096-7335-49b4-b193-1f960a03ddd9-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-b23bf096-7335-49b4-b193-1f960a03ddd9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "cinder-quobyte-b23bf096-7335-49b4-b193-1f960a03ddd9" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:45 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-b23bf096-7335-49b4-b193-1f960a03ddd9" acquired by "delete_volume" :: waited 0.041s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.771s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Deleted volume successfully. Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfceda-2295-44a1-9695-e128e797d095]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-eca7a612-560f-4aee-af8f-8483071e0e57 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-15bfcbcf-0855-413a-b066-1eba2e9f05d6-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:45 devstack sudo[86768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 Apr 30 11:06:45 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:46 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.822s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Deleted volume successfully. Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=152,cinder:SELECT=102,cinder:DELETE=12,cinder:INSERT=24 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e1c21a2b-115f-4ae7-9901-7877a0955d8d tempest-VolumesActionsTest-173251412 None] Lock "cinder-73d10dc8-7b56-40cc-b7dd-38da634e9e92-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (ba146df5-88e5-442e-a96a-0b5275ee8cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f1f005-3b22-46b4-aaae-e0f7c1c7e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f1f005-3b22-46b4-aaae-e0f7c1c7e37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-258262803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c719a0-811c-44d2-ad19-b58893d4cd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:46Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75181858-d12b-47c1-b9fe-021d63fddb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75181858-d12b-47c1-b9fe-021d63fddb67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cca4b0-ac73-43f2-9523-4860a4c55e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cca4b0-ac73-43f2-9523-4860a4c55e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4c719a0-811c-44d2-ad19-b58893d4cd96', 'volume_name': 'volume-b4c719a0-811c-44d2-ad19-b58893d4cd96', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39348456-5706-42e2-936a-7870dde5a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39348456-5706-42e2-936a-7870dde5a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eb404a-af29-4d97-bd38-51fbc305e632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:46 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Volume b4c719a0-811c-44d2-ad19-b58893d4cd96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4c719a0-811c-44d2-ad19-b58893d4cd96', 'volume_size': 1} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-258262803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4c719a0-811c-44d2-ad19-b58893d4cd96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf2a66c5594b62a2ad4a7a74c3160e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:06:46Z,use_quota=True,user_id='a5bda1011c094a4d9411d99bbb8aa256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Creating volume b4c719a0-811c-44d2-ad19-b58893d4cd96 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:06:46 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:46 devstack sudo[86817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 1073741824 Apr 30 11:06:46 devstack sudo[86817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:46 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9" returned: 0 in 0.899s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:46 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9 Apr 30 11:06:46 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:47 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b23bf096-7335-49b4-b193-1f960a03ddd9" returned: 0 in 0.714s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-quobyte-b23bf096-7335-49b4-b193-1f960a03ddd9" released by "delete_volume" :: held 1.690s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Created reservations ['66ff469e-9b6f-4e5f-9bd3-142ede450a53', '30f67bd4-ccfb-45f0-bac3-d2eb3af1084c', '973f10be-5aa9-40c3-8853-702317aab4e2', 'c80ecd9f-8d03-4f46-aee0-3e77c777ed4b'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:47 devstack sudo[86817]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 1073741824" returned: 0 in 0.969s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:47 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:47 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:47 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 Apr 30 11:06:47 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:48 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.713s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Deleted volume successfully. Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9fa74a2-7156-472f-a663-838ee4f08552 tempest-VolumesTestJSON-1383710722 None] Lock "cinder-b23bf096-7335-49b4-b193-1f960a03ddd9-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:48 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96" returned: 0 in 0.812s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09eb404a-af29-4d97-bd38-51fbc305e632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4c719a0-811c-44d2-ad19-b58893d4cd96', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be892586-490d-42b3-baaa-24a75b9aed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:06:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Volume volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 (b4c719a0-811c-44d2-ad19-b58893d4cd96): created successfully Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be892586-490d-42b3-baaa-24a75b9aed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:06:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Flow 'volume_create_manager' (ba146df5-88e5-442e-a96a-0b5275ee8cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:06:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b466ef70-a399-414f-bf45-42abeb3f8b74 tempest-VolumesActionsTest-1402307224 None] Created volume successfully. Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-b4c719a0-811c-44d2-ad19-b58893d4cd96-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "cinder-b4c719a0-811c-44d2-ad19-b58893d4cd96-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Acquiring lock "cinder-quobyte-b4c719a0-811c-44d2-ad19-b58893d4cd96" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "cinder-quobyte-b4c719a0-811c-44d2-ad19-b58893d4cd96" acquired by "delete_volume" :: waited 0.051s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a42b8e0-fa3e-4dc3-b071-1c2dd0b6c537]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:06:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:49 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 Apr 30 11:06:49 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:50 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96" returned: 0 in 1.080s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:50 devstack sudo[87201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96 Apr 30 11:06:50 devstack sudo[87201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:51 devstack sudo[87201]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b4c719a0-811c-44d2-ad19-b58893d4cd96" returned: 0 in 0.858s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "cinder-quobyte-b4c719a0-811c-44d2-ad19-b58893d4cd96" released by "delete_volume" :: held 2.002s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Created reservations ['a348a1c9-00e9-40fd-a82b-ed9119562c4f', '4a2b40fa-7a63-460e-bc56-49a5c84d8fce', '205f49e0-35ed-47ff-8248-2bdcd3902e34', 'c4e35a88-ec57-4f8f-b3d1-3a8e46901eae'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:06:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:06:51 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:06:51 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:06:52 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 30 11:06:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:06:52 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:06:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Deleted volume successfully. Apr 30 11:06:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-56c532ff-1b76-4ffc-ae37-f47737997dde tempest-VolumesActionsTest-1402307224 None] Lock "cinder-b4c719a0-811c-44d2-ad19-b58893d4cd96-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:06:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-112604c5-3daf-4139-afb4-4bc38a7b1473 tempest-BackendsCapabilitiesAdminTestsJSON-2107309880 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6563110351562, 'free_capacity_gb': 1775.6563110351562, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84206) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 30 11:06:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-281c6813-f6bd-49a2-b5ea-d91debebfd06 tempest-BackendsCapabilitiesAdminTestsJSON-2107309880 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6563110351562, 'free_capacity_gb': 1775.6563110351562, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84206) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 30 11:07:01 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=77,cinder:DELETE=8,cinder:SELECT=55,cinder:INSERT=22 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:07:02 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=18,cinder:DELETE=3 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:07 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:07 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-21f451f9-fb7d-466f-94b4-74428e91ce76 tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-1769904901: creating Apr 30 11:07:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-21f451f9-fb7d-466f-94b4-74428e91ce76 tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-1769904901: created successfully Apr 30 11:07:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-21f451f9-fb7d-466f-94b4-74428e91ce76 tempest-GroupSnapshotsTest-1286308054 None] Create group completed successfully. Apr 30 11:07:07 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.982s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (c799911e-e4a6-4a00-923d-81aab6dbd85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be6d30f-b7f2-4cf3-a270-12256570deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be6d30f-b7f2-4cf3-a270-12256570deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1945030612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5510aba-1ab4-4719-93eb-3f108383c99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:09Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38221f9-f205-4693-9d62-94035a4c6284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e38221f9-f205-4693-9d62-94035a4c6284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c889f-e90e-4582-b4db-6538f705927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (949c889f-e90e-4582-b4db-6538f705927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5510aba-1ab4-4719-93eb-3f108383c99a', 'volume_name': 'volume-f5510aba-1ab4-4719-93eb-3f108383c99a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6fabd7-aa69-445b-9335-4a8549c1017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6fabd7-aa69-445b-9335-4a8549c1017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abfed11-dcde-4bea-a2da-0779db874e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Volume f5510aba-1ab4-4719-93eb-3f108383c99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5510aba-1ab4-4719-93eb-3f108383c99a', 'volume_size': 1} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1945030612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5510aba-1ab4-4719-93eb-3f108383c99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:09Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Creating volume f5510aba-1ab4-4719-93eb-3f108383c99a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:09 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:09 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a 1073741824 Apr 30 11:07:09 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (1f4ce1f3-995c-409f-9599-404506bbbae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19895306-2461-4b55-8262-95946a50854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19895306-2461-4b55-8262-95946a50854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774161055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2d7c913-48b7-4a20-a2e2-0185ad29d329,host='devstack@QuobyteHD#QuobyteHD',id=9711b295-6c13-4170-9cc2-81f24a50d0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:09Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12fd897e-d486-467a-9414-1792ffc0718f),volume_type_id=12fd897e-d486-467a-9414-1792ffc0718f)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8789bc24-50d3-4957-a128-6f1581d32ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8789bc24-50d3-4957-a128-6f1581d32ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f84a1-539b-4633-beb0-0e46c172efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f84a1-539b-4633-beb0-0e46c172efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9711b295-6c13-4170-9cc2-81f24a50d0a0', 'volume_name': 'volume-9711b295-6c13-4170-9cc2-81f24a50d0a0', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4111a8-f05c-44c5-b5d8-88953c141efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e4111a8-f05c-44c5-b5d8-88953c141efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f13900-a648-4b57-87f9-630671050350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:09 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Volume 9711b295-6c13-4170-9cc2-81f24a50d0a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9711b295-6c13-4170-9cc2-81f24a50d0a0', 'volume_size': 1} Apr 30 11:07:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:10 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a 1073741824" returned: 0 in 1.120s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:10 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a Apr 30 11:07:10 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:10 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a" returned: 0 in 0.660s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2d7c913-48b7-4a20-a2e2-0185ad29d329,created_at=2026-04-30T09:07:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774161055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2d7c913-48b7-4a20-a2e2-0185ad29d329,host='devstack@QuobyteHD#QuobyteHD',id=9711b295-6c13-4170-9cc2-81f24a50d0a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:09Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12fd897e-d486-467a-9414-1792ffc0718f),volume_type_id=12fd897e-d486-467a-9414-1792ffc0718f)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Creating volume 9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:10 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abfed11-dcde-4bea-a2da-0779db874e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5510aba-1ab4-4719-93eb-3f108383c99a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:11 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 1073741824 Apr 30 11:07:11 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74c4096-3e2f-4971-9d17-9c41b87d8482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Volume volume-f5510aba-1ab4-4719-93eb-3f108383c99a (f5510aba-1ab4-4719-93eb-3f108383c99a): created successfully Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a74c4096-3e2f-4971-9d17-9c41b87d8482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (c799911e-e4a6-4a00-923d-81aab6dbd85e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6216a994-df2e-4929-93d1-e1653e06cb49 tempest-VolumesListAdminTestJSON-1545543808 None] Created volume successfully. Apr 30 11:07:11 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 1073741824" returned: 0 in 0.965s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:11 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:11 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:13 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 1.236s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (ef974a89-5c71-4acb-9a89-67938c4b0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1853fd37-1062-4dd2-9ecc-306a490cf5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f13900-a648-4b57-87f9-630671050350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9711b295-6c13-4170-9cc2-81f24a50d0a0', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632c1e6c-bd74-456a-a573-f860e26a5387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1853fd37-1062-4dd2-9ecc-306a490cf5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-229577051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7530b640-7a87-490c-82a1-f797684a2994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:13Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ff4da3-a4b4-482b-855f-136302863fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ff4da3-a4b4-482b-855f-136302863fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b861ec5-264d-4fbe-8321-2a244c8fa41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b861ec5-264d-4fbe-8321-2a244c8fa41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7530b640-7a87-490c-82a1-f797684a2994', 'volume_name': 'volume-7530b640-7a87-490c-82a1-f797684a2994', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7dfa66-f7d1-42c0-9216-830db53c03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7dfa66-f7d1-42c0-9216-830db53c03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb40d2-2b53-4ea7-9091-6b6142e882b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:13 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Volume 7530b640-7a87-490c-82a1-f797684a2994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7530b640-7a87-490c-82a1-f797684a2994', 'volume_size': 1} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-229577051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7530b640-7a87-490c-82a1-f797684a2994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:13Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Creating volume 7530b640-7a87-490c-82a1-f797684a2994 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:13 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:13 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Volume volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 (9711b295-6c13-4170-9cc2-81f24a50d0a0): created successfully Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632c1e6c-bd74-456a-a573-f860e26a5387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:13 devstack sudo[87440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 1073741824 Apr 30 11:07:13 devstack sudo[87440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (1f4ce1f3-995c-409f-9599-404506bbbae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-44bb2757-9d01-4e89-98e0-a64d77e1f9b5 tempest-GroupSnapshotsTest-1286308054 None] Created volume successfully. Apr 30 11:07:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] GroupSnapshot b199c61b-a0ec-4950-b690-9d462dba4406: creating. Apr 30 11:07:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Group snapshot b199c61b-a0ec-4950-b690-9d462dba4406: creating. {{(pid=84206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:07:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:14 devstack sudo[87440]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 1073741824" returned: 0 in 1.149s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:14 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 Apr 30 11:07:14 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:15 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994" returned: 0 in 0.795s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.019s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb40d2-2b53-4ea7-9091-6b6142e882b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7530b640-7a87-490c-82a1-f797684a2994', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9da8ce0-0ea2-4b99-a18b-e5049651035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Creating offline snapshot 7f010092-f4eb-4d6f-b93c-6d93c245f10b of volume 9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:07:15 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Volume volume-7530b640-7a87-490c-82a1-f797684a2994 (7530b640-7a87-490c-82a1-f797684a2994): created successfully Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9da8ce0-0ea2-4b99-a18b-e5049651035d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (ef974a89-5c71-4acb-9a89-67938c4b0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445db8a-4248-4cdd-8d44-64efa129d8b2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7cbede48-a5db-4258-ae6e-a9a9f525627a tempest-VolumesListAdminTestJSON-1545543808 None] Created volume successfully. Apr 30 11:07:15 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:15 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:16 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 0.818s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:16 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b 1G Apr 30 11:07:16 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:16 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (954322cc-630c-4817-9270-0845884e1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611bd46c-d867-4a9d-b0c3-666cd2cdf7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611bd46c-d867-4a9d-b0c3-666cd2cdf7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836920413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe1d0e9-4289-422d-ae2f-d4cd3da1cdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:17Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce466e4-7ada-478b-b566-0d4307816bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce466e4-7ada-478b-b566-0d4307816bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503ed0a9-8a4b-4e2f-95fc-b30c71cec33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503ed0a9-8a4b-4e2f-95fc-b30c71cec33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe1d0e9-4289-422d-ae2f-d4cd3da1cdff', 'volume_name': 'volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5c3336-6a5a-46cc-ac02-5ec4527031d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5c3336-6a5a-46cc-ac02-5ec4527031d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ed8806-c1af-4073-9665-b81e0c074e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:17 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Volume efe1d0e9-4289-422d-ae2f-d4cd3da1cdff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff', 'volume_size': 1} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:17 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b 1G" returned: 0 in 1.015s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:17 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:17 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:18 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 0.746s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:18 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:07:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:18 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:18 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:18 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 0.698s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:18 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info Apr 30 11:07:18 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:19 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info" returned: 0 in 0.795s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:19 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:07:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:19 devstack sudo[87499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info Apr 30 11:07:19 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Flow 'volume_create_manager' (d178c3e6-3b48-4225-8e29-14cbf4cea7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a3ba5-529f-48ff-af14-0f73e9ade816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a3ba5-529f-48ff-af14-0f73e9ade816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1048455860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f68a85b-f93c-4f98-96f3-c18b186edccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f3093ecf5446eea1b8ea9603c8eeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:20Z,use_quota=True,user_id='ba6528bba9ab4fd8b7f00c1f23ce6026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ed640a-a6f3-42d9-87a4-1ab86a53fb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ed640a-a6f3-42d9-87a4-1ab86a53fb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dc1dd4-b569-4329-a47d-88d99b4a6b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69dc1dd4-b569-4329-a47d-88d99b4a6b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f68a85b-f93c-4f98-96f3-c18b186edccc', 'volume_name': 'volume-1f68a85b-f93c-4f98-96f3-c18b186edccc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05be5c3b-0517-487f-b62b-933977b4f94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05be5c3b-0517-487f-b62b-933977b4f94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472a3d5-22b5-4eed-8911-071e9ee19c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume 1f68a85b-f93c-4f98-96f3-c18b186edccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f68a85b-f93c-4f98-96f3-c18b186edccc', 'volume_size': 1} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:20 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.info" returned: 0 in 0.718s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.915s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.198s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-836920413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe1d0e9-4289-422d-ae2f-d4cd3da1cdff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45af710966c49738afc140693c3baa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:17Z,use_quota=True,user_id='8ba38e55565a4dc4bc9d47c429dc1bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Creating volume efe1d0e9-4289-422d-ae2f-d4cd3da1cdff {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:20 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:20 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff 1073741824 Apr 30 11:07:20 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-92da43c8-bb01-4f8e-8878-0c73dea4fe0d tempest-GroupSnapshotsTest-1286308054 None] group_snapshot b199c61b-a0ec-4950-b690-9d462dba4406: created successfully Apr 30 11:07:21 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff 1073741824" returned: 0 in 0.946s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:21 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff Apr 30 11:07:21 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:22 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" returned: 0 in 0.840s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1048455860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f68a85b-f93c-4f98-96f3-c18b186edccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f3093ecf5446eea1b8ea9603c8eeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:20Z,use_quota=True,user_id='ba6528bba9ab4fd8b7f00c1f23ce6026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Creating volume 1f68a85b-f93c-4f98-96f3-c18b186edccc {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:22 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:22 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc 1073741824 Apr 30 11:07:22 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ed8806-c1af-4073-9665-b81e0c074e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f1bd8f-8b2e-4945-bbf1-3cfff3e93b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:22 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Volume volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff (efe1d0e9-4289-422d-ae2f-d4cd3da1cdff): created successfully Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f1bd8f-8b2e-4945-bbf1-3cfff3e93b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Flow 'volume_create_manager' (954322cc-630c-4817-9270-0845884e1793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-505e8fbd-dee7-41ce-bdc3-8c8e5ffb5f77 tempest-VolumesListAdminTestJSON-1545543808 None] Created volume successfully. Apr 30 11:07:23 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc 1073741824" returned: 0 in 0.998s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:23 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc Apr 30 11:07:23 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:23 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc" returned: 0 in 0.652s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.820s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Creating volume 6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 from snapshot 7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e472a3d5-22b5-4eed-8911-071e9ee19c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f68a85b-f93c-4f98-96f3-c18b186edccc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cfb166-7081-4c61-ac5f-ab9226ac35d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] snapshot: 7f010092-f4eb-4d6f-b93c-6d93c245f10b, volume: 6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume volume-1f68a85b-f93c-4f98-96f3-c18b186edccc (1f68a85b-f93c-4f98-96f3-c18b186edccc): created successfully Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cfb166-7081-4c61-ac5f-ab9226ac35d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Flow 'volume_create_manager' (d178c3e6-3b48-4225-8e29-14cbf4cea7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce27eeb-dce9-415f-b941-1628f4677179]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7104d298-41df-428a-88cb-c3b639abaf9b tempest-VolumeQuotasAdminTestJSON-22169577 None] Created volume successfully. Apr 30 11:07:24 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:24 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Flow 'volume_create_manager' (ee8f3b65-81a0-4da4-aaa3-8159bdf8eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dbe3c4-6771-4269-98aa-e0c48141f44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8dbe3c4-6771-4269-98aa-e0c48141f44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9674ac4d-1ae4-4f2f-9fad-895b88c788d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b383ca598ee94607b504cc410351d66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:24Z,use_quota=True,user_id='40346863442c484e8b1fabfe2245f86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf70fe5-3aad-4d87-890d-4915c297a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaf70fe5-3aad-4d87-890d-4915c297a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0534f54-7c68-4b86-87fa-c98c7ee1e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0534f54-7c68-4b86-87fa-c98c7ee1e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9674ac4d-1ae4-4f2f-9fad-895b88c788d7', 'volume_name': 'volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97dc9c-8f85-45c2-a0c3-1429aefead89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97dc9c-8f85-45c2-a0c3-1429aefead89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e6adcc-f875-4960-9251-574d29032a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Volume 9674ac4d-1ae4-4f2f-9fad-895b88c788d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7', 'volume_size': 1} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "cinder-1f68a85b-f93c-4f98-96f3-c18b186edccc-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "cinder-1f68a85b-f93c-4f98-96f3-c18b186edccc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "cinder-quobyte-1f68a85b-f93c-4f98-96f3-c18b186edccc" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "cinder-quobyte-1f68a85b-f93c-4f98-96f3-c18b186edccc" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d2bc0-ede9-45f2-93a9-c47310c455ee]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:24 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc Apr 30 11:07:24 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:24 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 0.909s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9711b295-6c13-4170-9cc2-81f24a50d0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9915d164-cf04-44ec-93cf-4dfda3ecd879]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:25 devstack sudo[87546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:25 devstack sudo[87546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:25 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc" returned: 0 in 0.701s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:25 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc Apr 30 11:07:25 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:25 devstack sudo[87546]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 0.762s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:25 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 Apr 30 11:07:25 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:25 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f68a85b-f93c-4f98-96f3-c18b186edccc" returned: 0 in 0.574s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "cinder-quobyte-1f68a85b-f93c-4f98-96f3-c18b186edccc" released by "delete_volume" :: held 1.333s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:25 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Created reservations ['e5c78346-5160-4efd-834c-547549030e78', '88716ac2-feae-46bd-99c0-4cd75d4a0dbe', '4489e51f-af37-4b1f-a75b-fe78446c41f7', '74b7d319-a11b-4bc1-bf98-f2f59879d37e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:26 devstack sudo[87561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:26 devstack sudo[87561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:27 devstack sudo[87561]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.000s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Deleted volume successfully. Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c4a1b07e-c87d-4052-82f3-28b30f2ac042 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "cinder-1f68a85b-f93c-4f98-96f3-c18b186edccc-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Flow 'volume_create_manager' (f460c885-408f-4251-af6f-d5bf4044b6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bd9ea-b664-43e6-94f0-02ba8dc6dafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3bd9ea-b664-43e6-94f0-02ba8dc6dafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522764111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef6a7af-c606-4406-8a02-1fce402e16b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f3093ecf5446eea1b8ea9603c8eeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:28Z,use_quota=True,user_id='ba6528bba9ab4fd8b7f00c1f23ce6026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39acec37-c251-409c-91b6-eaf5249e5da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39acec37-c251-409c-91b6-eaf5249e5da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4c9032-5bc2-4570-b998-5eef74f3e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4c9032-5bc2-4570-b998-5eef74f3e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef6a7af-c606-4406-8a02-1fce402e16b7', 'volume_name': 'volume-fef6a7af-c606-4406-8a02-1fce402e16b7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb6fb77-59f8-4651-a169-25348501b8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb6fb77-59f8-4651-a169-25348501b8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8ae937-46b9-49d8-a8d4-37ef0a1f9cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume fef6a7af-c606-4406-8a02-1fce402e16b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef6a7af-c606-4406-8a02-1fce402e16b7', 'volume_size': 1} Apr 30 11:07:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:32 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" returned: 0 in 6.519s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:32 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a56730-bce2-403d-a6cb-ffc6b504dedd]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:32 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:32 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:33 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 0.973s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:07:33 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Converted 1024.00 MB image at 157.07 MB/s Apr 30 11:07:33 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:33 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 Apr 30 11:07:33 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:33 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" returned: 0 in 0.650s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" released by "_create_volume_from_snapshot" :: held 10.038s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.064s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.421s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9674ac4d-1ae4-4f2f-9fad-895b88c788d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b383ca598ee94607b504cc410351d66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:24Z,use_quota=True,user_id='40346863442c484e8b1fabfe2245f86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Creating volume 9674ac4d-1ae4-4f2f-9fad-895b88c788d7 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:33 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:33 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 1073741824 Apr 30 11:07:33 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-563e3e74-adf0-40f5-b437-f4029fcd6fd1 tempest-GroupSnapshotsTest-1286308054 None] Create group from source-snapshot-b199c61b-a0ec-4950-b690-9d462dba4406 completed successfully. Apr 30 11:07:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f201f7b8-a0fa-49f8-9ce8-b3ca82fdfa45]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:34 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 Apr 30 11:07:34 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:35 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 1073741824" returned: 0 in 1.117s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:35 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 Apr 30 11:07:35 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:35 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" returned: 0 in 0.909s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:35 devstack sudo[87657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4 Apr 30 11:07:35 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:35 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" returned: 0 in 0.719s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.936s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-522764111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef6a7af-c606-4406-8a02-1fce402e16b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65f3093ecf5446eea1b8ea9603c8eeba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:28Z,use_quota=True,user_id='ba6528bba9ab4fd8b7f00c1f23ce6026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Creating volume fef6a7af-c606-4406-8a02-1fce402e16b7 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:35 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e6adcc-f875-4960-9251-574d29032a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:35 devstack sudo[87660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 1073741824 Apr 30 11:07:35 devstack sudo[87660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c58e4b-8b95-4953-8380-9af282e1a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:35 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Volume volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 (9674ac4d-1ae4-4f2f-9fad-895b88c788d7): created successfully Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c58e4b-8b95-4953-8380-9af282e1a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Flow 'volume_create_manager' (ee8f3b65-81a0-4da4-aaa3-8159bdf8eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8af6e48a-1ad5-4a9b-be73-90184d25371e tempest-VolumesListAdminTestJSON-916710424 None] Created volume successfully. Apr 30 11:07:36 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" returned: 0 in 0.796s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-6eb8bb35-4bc1-44f9-9f5d-2d44e02489a4" released by "delete_volume" :: held 1.756s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['c74b390b-ca05-4217-8eb7-580a5101eabf'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:36 devstack cinder-volume[84206]: WARNING cinder.quota [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-690244718 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-690244718, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:07:36 devstack cinder-volume[84206]: WARNING cinder.quota [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-690244718 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-690244718, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['b5e652be-faca-45fc-998c-5c636f13477a', 'f9ef352b-8722-4bb6-b61e-e6936d434fcd', '58a54ebc-37d2-4a25-a897-31e69d538f39', 'fc45682e-1b76-4557-9728-00df4ee2ab22'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:36 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:36 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Acquiring lock "cinder-9674ac4d-1ae4-4f2f-9fad-895b88c788d7-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] group_snapshot b199c61b-a0ec-4950-b690-9d462dba4406: deleting Apr 30 11:07:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "cinder-9674ac4d-1ae4-4f2f-9fad-895b88c788d7-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] group_snapshot b199c61b-a0ec-4950-b690-9d462dba4406: deleting {{(pid=84206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Acquiring lock "cinder-quobyte-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "cinder-quobyte-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" acquired by "delete_volume" :: waited 0.069s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" acquired by "delete_snapshot" :: waited 0.134s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe987060-6da3-4583-890a-da595d25ed65]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:37 devstack sudo[87660]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b" acquired by "_delete_snapshot" :: waited 0.073s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Deleting offline snapshot 7f010092-f4eb-4d6f-b93c-6d93c245f10b of volume 9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] snapshot_file for this snap is: volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b44041d-ab91-4eb0-a12f-0459b1941e0f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 1073741824" returned: 0 in 1.589s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:37 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 Apr 30 11:07:37 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:37 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 Apr 30 11:07:37 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-quobyte-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:37 devstack sudo[87670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" acquired by "delete_volume" :: waited 0.051s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:37 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3d481-af2b-4bd2-8ea1-a563c0127860]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:37 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.143s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:37 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0bd84693-0f85-4c58-a694-852cf57e991d tempest-GroupSnapshotsTest-1286308054 None] Delete group completed successfully. Apr 30 11:07:37 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff Apr 30 11:07:37 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:38 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 1.332s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9711b295-6c13-4170-9cc2-81f24a50d0a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:07:38 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7" returned: 0 in 1.243s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] <== create_volume: return (2960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.965s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc82ab8-c11c-42ba-a684-f3e2514efb45]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8ae937-46b9-49d8-a8d4-37ef0a1f9cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef6a7af-c606-4406-8a02-1fce402e16b7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b52f74d-9344-4a8c-9b5f-612a7e81fd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Volume volume-fef6a7af-c606-4406-8a02-1fce402e16b7 (fef6a7af-c606-4406-8a02-1fce402e16b7): created successfully Apr 30 11:07:38 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b52f74d-9344-4a8c-9b5f-612a7e81fd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Flow 'volume_create_manager' (f460c885-408f-4251-af6f-d5bf4044b6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" returned: 0 in 1.692s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7b3ddede-8915-4fc9-91c8-bf2934163909 tempest-VolumeQuotasAdminTestJSON-22169577 None] Created volume successfully. Apr 30 11:07:39 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:39 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:39 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7 Apr 30 11:07:39 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:39 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" returned: 0 in 1.490s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:39 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff Apr 30 11:07:39 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:39 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" returned: 0 in 0.762s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff" released by "delete_volume" :: held 2.354s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:40 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 1.260s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:40 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Created reservations ['f125a85e-a6d2-4778-92cd-da68e6a9be7e', '0be14480-91f3-46a2-ae05-02bc3f415da8', '3051f648-171f-4759-a36a-167be90cab71', '46fa4c39-5687-46fc-8592-f5ce5a38f86f'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:40 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:40 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:40 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:40 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" returned: 0 in 1.392s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "cinder-quobyte-9674ac4d-1ae4-4f2f-9fad-895b88c788d7" released by "delete_volume" :: held 3.209s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Created reservations ['e6fe685b-039d-4cb8-b47d-30e3a24d4450', '71b3545a-abc3-4698-b5eb-dc24de028cd3', 'bf08fd25-f27a-498b-a32e-dde1c92b96f2', 'cd8d46e6-c56f-4bdf-a818-c343beea6d14'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:40 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:40 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-7530b640-7a87-490c-82a1-f797684a2994-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-7530b640-7a87-490c-82a1-f797684a2994-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-quobyte-7530b640-7a87-490c-82a1-f797684a2994" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-7530b640-7a87-490c-82a1-f797684a2994" acquired by "delete_volume" :: waited 0.094s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:41 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 1.493s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41df020e-0628-4c27-9af1-a97620fc59a5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:41 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b Apr 30 11:07:41 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:41 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.603s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:41 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Deleted volume successfully. Apr 30 11:07:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6ddf9d21-f8df-4eb3-83a5-ac587df7adb9 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-efe1d0e9-4289-422d-ae2f-d4cd3da1cdff-delete_volume" released by "delete_volume" :: held 4.451s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:41 devstack sudo[87785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 Apr 30 11:07:41 devstack sudo[87785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:42 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.274s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:42 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Deleted volume successfully. Apr 30 11:07:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ebe41a3-d41e-4a63-b3c5-7cd5027190ae tempest-VolumesListAdminTestJSON-916710424 None] Lock "cinder-9674ac4d-1ae4-4f2f-9fad-895b88c788d7-delete_volume" released by "delete_volume" :: held 5.130s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a1528fa4-c111-4fb9-b3f1-531aced460b0 tempest-VolumeQuotasAdminTestJSON-640895633 None] Transfer volume completed successfully. Apr 30 11:07:42 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0.7f010092-f4eb-4d6f-b93c-6d93c245f10b" returned: 0 in 1.406s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:43 devstack sudo[87785]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994" returned: 0 in 1.408s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-7f010092-f4eb-4d6f-b93c-6d93c245f10b" released by "_delete_snapshot" :: held 5.714s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" released by "delete_snapshot" :: held 5.808s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:43 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994 Apr 30 11:07:43 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:43 devstack cinder-volume[84206]: WARNING cinder.quota [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-690244718 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-690244718, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['1a6d3039-6e2d-4930-920e-7c71f834dcf9', 'bde7d31d-af2f-468b-a4a9-899bbd38940a', '8f20d8aa-408b-4ce7-9da0-2070677d7a42', 'dc29f2a1-3e37-46aa-9dfd-99dee01aab75'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bc2bc08c-70e4-4d9c-8564-70b2b543fb5c tempest-GroupSnapshotsTest-1286308054 None] group_snapshot b199c61b-a0ec-4950-b690-9d462dba4406: deleted successfully Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Acquiring lock "cinder-fef6a7af-c606-4406-8a02-1fce402e16b7-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "cinder-fef6a7af-c606-4406-8a02-1fce402e16b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Acquiring lock "cinder-quobyte-fef6a7af-c606-4406-8a02-1fce402e16b7" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "cinder-quobyte-fef6a7af-c606-4406-8a02-1fce402e16b7" acquired by "delete_volume" :: waited 0.044s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e1cf21-8e1a-4d5c-929b-04c8c8bc6837]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:44 devstack sudo[87818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 Apr 30 11:07:44 devstack sudo[87818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cd950b-b811-43cc-9360-a08ea6bf160a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:44 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7530b640-7a87-490c-82a1-f797684a2994" returned: 0 in 1.254s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-7530b640-7a87-490c-82a1-f797684a2994" released by "delete_volume" :: held 2.779s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Created reservations ['6ecfaa53-a33a-4203-bc45-1c0c66beb090', '8fd0dfb1-e514-4e67-9996-e72f91cbf1ab', '92a43526-c3d7-4b4d-8953-b437a8d6361a', 'fd61810d-f31b-4903-bc1e-1e6efebe8b0e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:44 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:44 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:44 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:44 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:44 devstack sudo[87818]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7" returned: 0 in 1.016s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:44 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7 Apr 30 11:07:44 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-f5510aba-1ab4-4719-93eb-3f108383c99a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-f5510aba-1ab4-4719-93eb-3f108383c99a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "cinder-quobyte-f5510aba-1ab4-4719-93eb-3f108383c99a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-f5510aba-1ab4-4719-93eb-3f108383c99a" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c64176-2769-47df-b8c9-149d5b9fbe20]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:45 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Deleted volume successfully. Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7998af4-b0ea-4b97-82ac-e722bc72a113 tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-7530b640-7a87-490c-82a1-f797684a2994-delete_volume" released by "delete_volume" :: held 3.967s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:45 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a Apr 30 11:07:45 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:45 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 1.189s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:45 devstack sudo[87837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0 Apr 30 11:07:45 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:45 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fef6a7af-c606-4406-8a02-1fce402e16b7" returned: 0 in 0.794s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "cinder-quobyte-fef6a7af-c606-4406-8a02-1fce402e16b7" released by "delete_volume" :: held 1.883s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Created reservations ['68bec651-3fd9-4130-bb89-7abc8be7cee8', 'af8b03da-738b-4ac0-bde8-6a42207163b4', '6cb59fa1-bd3f-481e-9867-250c69f3aa5e', '4de5b9dd-2567-4f52-b69b-8e059a7b1e44'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:45 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:45 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:46 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a" returned: 0 in 0.854s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:46 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a Apr 30 11:07:46 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:46 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9711b295-6c13-4170-9cc2-81f24a50d0a0" returned: 0 in 0.728s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-9711b295-6c13-4170-9cc2-81f24a50d0a0" released by "delete_volume" :: held 2.021s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['98574641-cf62-467a-bd0a-522b32a4738a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:46 devstack cinder-volume[84206]: WARNING cinder.db.sqlalchemy.api [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-690244718'] Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['06ff8b6a-0738-488c-aa88-03ed66519267', 'f5bdc2ac-ee35-48ca-ae21-a5ee4ad9aeb3', '88cc8b0f-9481-4ee3-9e6d-2f0457c90d85', 'ed1f154f-079c-4a1e-b26b-f0ae163d14db'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:46 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:46 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:46 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.914s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Deleted volume successfully. Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2701f1ee-4306-4eb4-bc0b-2d7878e91014 tempest-VolumeQuotasAdminTestJSON-1235125170 None] Lock "cinder-fef6a7af-c606-4406-8a02-1fce402e16b7-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:46 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f5510aba-1ab4-4719-93eb-3f108383c99a" returned: 0 in 0.895s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-quobyte-f5510aba-1ab4-4719-93eb-3f108383c99a" released by "delete_volume" :: held 1.799s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:46 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Created reservations ['1446699c-23cf-4f1f-887d-a4a6530ba7ec', '917a567e-d361-40b9-b5cd-c9c76278a645', '6af4e144-fbbd-463a-9a24-f538eec561bc', 'c9ad89c7-b9c6-4b6d-8db8-add1257e1710'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:47 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:07:47 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:47 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.767s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-81a20f5d-0f07-442c-aa8c-c8857ccdfaf6 tempest-GroupSnapshotsTest-1286308054 None] Delete group completed successfully. Apr 30 11:07:47 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.839s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:07:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Deleted volume successfully. Apr 30 11:07:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b3ba351-009f-4946-9e36-f5554eba428f tempest-VolumesListAdminTestJSON-1545543808 None] Lock "cinder-f5510aba-1ab4-4719-93eb-3f108383c99a-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:07:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e5171c2e-7314-4700-83df-6fcdee05afa1 tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-831685457: creating Apr 30 11:07:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e5171c2e-7314-4700-83df-6fcdee05afa1 tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-831685457: created successfully Apr 30 11:07:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e5171c2e-7314-4700-83df-6fcdee05afa1 tempest-GroupSnapshotsTest-1286308054 None] Create group completed successfully. Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (bd19c1ab-3540-42da-a536-911c385af494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6f69c-b8b3-4006-9214-dfefa951790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a6f69c-b8b3-4006-9214-dfefa951790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847027584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,host='devstack@QuobyteHD#QuobyteHD',id=a2cabecd-af54-406e-9fc4-a0fed4840366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:50Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f6fdb7f-7041-4d4f-9582-bcef19952eb1),volume_type_id=5f6fdb7f-7041-4d4f-9582-bcef19952eb1)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a596fccf-4fe6-43d6-84cd-2bf8d67de637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a596fccf-4fe6-43d6-84cd-2bf8d67de637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc817771-6f76-4274-aa1a-1cbc86b60c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc817771-6f76-4274-aa1a-1cbc86b60c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cabecd-af54-406e-9fc4-a0fed4840366', 'volume_name': 'volume-a2cabecd-af54-406e-9fc4-a0fed4840366', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e0e258-a6dd-4898-821a-885965ed28b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e0e258-a6dd-4898-821a-885965ed28b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198acc66-e3d0-4f2d-88e0-1feb4b54acaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Volume a2cabecd-af54-406e-9fc4-a0fed4840366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cabecd-af54-406e-9fc4-a0fed4840366', 'volume_size': 1} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,created_at=2026-04-30T09:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1847027584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,host='devstack@QuobyteHD#QuobyteHD',id=a2cabecd-af54-406e-9fc4-a0fed4840366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:50Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f6fdb7f-7041-4d4f-9582-bcef19952eb1),volume_type_id=5f6fdb7f-7041-4d4f-9582-bcef19952eb1)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Creating volume a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:50 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:50 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 1073741824 Apr 30 11:07:50 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:51 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 1073741824" returned: 0 in 1.264s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:51 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 Apr 30 11:07:51 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:52 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198acc66-e3d0-4f2d-88e0-1feb4b54acaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cabecd-af54-406e-9fc4-a0fed4840366', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3015e3d-6a6e-46a7-9e65-f5a95b7d00c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Volume volume-a2cabecd-af54-406e-9fc4-a0fed4840366 (a2cabecd-af54-406e-9fc4-a0fed4840366): created successfully Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3015e3d-6a6e-46a7-9e65-f5a95b7d00c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (bd19c1ab-3540-42da-a536-911c385af494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7c5042bf-7e50-48a3-88e9-622c96554e37 tempest-GroupSnapshotsTest-1286308054 None] Created volume successfully. Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (6920f6d5-f740-4821-8321-db855f12eb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948be9b0-3f3f-4e0b-9e96-8bc20298164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948be9b0-3f3f-4e0b-9e96-8bc20298164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779401002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,host='devstack@QuobyteHD#QuobyteHD',id=4d165cd5-90c7-4fab-b438-1c336eef2eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:54Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f6fdb7f-7041-4d4f-9582-bcef19952eb1),volume_type_id=5f6fdb7f-7041-4d4f-9582-bcef19952eb1)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d4621a-5a11-472b-ab31-61efefa921d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d4621a-5a11-472b-ab31-61efefa921d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85fd21-54d1-4e24-a432-a0d2c17a2914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d85fd21-54d1-4e24-a432-a0d2c17a2914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d165cd5-90c7-4fab-b438-1c336eef2eef', 'volume_name': 'volume-4d165cd5-90c7-4fab-b438-1c336eef2eef', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55375e0b-b6b2-409c-816a-bd557621591d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55375e0b-b6b2-409c-816a-bd557621591d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0adaa7-a23d-4696-a67a-e81b818f1c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Volume 4d165cd5-90c7-4fab-b438-1c336eef2eef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d165cd5-90c7-4fab-b438-1c336eef2eef', 'volume_size': 1} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,created_at=2026-04-30T09:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779401002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0810f76f-8fd8-4193-9f7a-37a29ba64b55,host='devstack@QuobyteHD#QuobyteHD',id=4d165cd5-90c7-4fab-b438-1c336eef2eef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:54Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f6fdb7f-7041-4d4f-9582-bcef19952eb1),volume_type_id=5f6fdb7f-7041-4d4f-9582-bcef19952eb1)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Creating volume 4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:54 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:54 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef 1073741824 Apr 30 11:07:54 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Flow 'volume_create_manager' (6ee68398-aedf-4c7f-bf67-84d4b9a97a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cd4b25-d6bf-47c2-9b08-a51b05a4fbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cd4b25-d6bf-47c2-9b08-a51b05a4fbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-255250422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41038b4-4b95-4d71-bb8a-bba073ad5f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c481608d554410a5f35f5bc16ea7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:55Z,use_quota=True,user_id='75299e77acf84c0286e44574b1c75840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6506eb0c-054b-4e69-b5dc-80bcf3154078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6506eb0c-054b-4e69-b5dc-80bcf3154078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60c160-b9d0-411a-a830-b448c6899a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:54 devstack cinder-volume[84206]: DEBUG cinder.image.glance [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Creating Keystone auth plugin from conf {{(pid=84206) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c60c160-b9d0-411a-a830-b448c6899a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e41038b4-4b95-4d71-bb8a-bba073ad5f0f', 'volume_name': 'volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea89f984-b70b-47e6-b834-2edc20ee7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea89f984-b70b-47e6-b834-2edc20ee7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dd4bc6-437c-4512-a1d8-e66358e4619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:55 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Trying to clone e41038b4-4b95-4d71-bb8a-bba073ad5f0f from image 9165766b-a0b9-4919-8d55-0a96e0f54340 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]). {{(pid=84206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 30 11:07:55 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef 1073741824" returned: 0 in 1.296s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:56 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef Apr 30 11:07:56 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:07:56 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Flow 'volume_create_manager' (e08991f2-bf67-4a6e-b9bb-ea7a1460f225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2634e5-526e-4477-bbee-1a12c0e11b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e3fa27-79dc-4436-9516-1e31ed1d70cf]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Flow 'volume_create_manager' (a5c6e1b1-c45d-4467-a63a-2ccf6e5e9fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bae3c0-f0f0-4786-8611-92ce4f0d2586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2634e5-526e-4477-bbee-1a12c0e11b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea89cba8-05c7-4e34-b7e5-800414e6b643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194b58baa879465c826ef22634233cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:56Z,use_quota=True,user_id='ecdab2bdf85b474a88581eac50d7527a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4379f3-9f29-4a66-9cf3-cc3cf8a6fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4379f3-9f29-4a66-9cf3-cc3cf8a6fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a059cb60-bdb3-4633-b6f6-c94b6f64fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.image.glance [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Creating Keystone auth plugin from conf {{(pid=84206) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:07:56 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD Apr 30 11:07:56 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bae3c0-f0f0-4786-8611-92ce4f0d2586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1371391216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1394d33b-cb0a-4dfe-89be-374f043abea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838efd6480742e09665e82995b1c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:56Z,use_quota=True,user_id='a16d6967e01542bcae4dfddaf6125d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da66f5e5-a752-4e78-9cfa-dd168901a565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da66f5e5-a752-4e78-9cfa-dd168901a565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e9372-d1c8-467b-bab5-52b5655bcde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49e9372-d1c8-467b-bab5-52b5655bcde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1394d33b-cb0a-4dfe-89be-374f043abea6', 'volume_name': 'volume-1394d33b-cb0a-4dfe-89be-374f043abea6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb2822-9724-472f-8f80-e23503a37921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1feb2822-9724-472f-8f80-e23503a37921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022610e-3bd6-4849-b35c-d1744f2f0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Volume 1394d33b-cb0a-4dfe-89be-374f043abea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1394d33b-cb0a-4dfe-89be-374f043abea6', 'volume_size': 1} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:56 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef" returned: 0 in 0.860s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.061s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1371391216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1394d33b-cb0a-4dfe-89be-374f043abea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838efd6480742e09665e82995b1c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:56Z,use_quota=True,user_id='a16d6967e01542bcae4dfddaf6125d8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Creating volume 1394d33b-cb0a-4dfe-89be-374f043abea6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:56 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:56 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 1073741824 Apr 30 11:07:56 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e0adaa7-a23d-4696-a67a-e81b818f1c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d165cd5-90c7-4fab-b438-1c336eef2eef', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21914ca1-06f5-49fc-bfb7-b3e36772b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:56 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Volume volume-4d165cd5-90c7-4fab-b438-1c336eef2eef (4d165cd5-90c7-4fab-b438-1c336eef2eef): created successfully Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21914ca1-06f5-49fc-bfb7-b3e36772b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:56 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (6920f6d5-f740-4821-8321-db855f12eb0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2c4c55de-61d8-4514-9c43-824dc97758d6 tempest-GroupSnapshotsTest-1286308054 None] Created volume successfully. Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a059cb60-bdb3-4633-b6f6-c94b6f64fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ea89cba8-05c7-4e34-b7e5-800414e6b643', 'volume_name': 'volume-ea89cba8-05c7-4e34-b7e5-800414e6b643', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5929dfbd-0d86-4c40-8c63-433ec6bee12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5929dfbd-0d86-4c40-8c63-433ec6bee12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb130839-f383-441f-a848-24aede10fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:57 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume ea89cba8-05c7-4e34-b7e5-800414e6b643: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ea89cba8-05c7-4e34-b7e5-800414e6b643', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Trying to clone ea89cba8-05c7-4e34-b7e5-800414e6b643 from image 9165766b-a0b9-4919-8d55-0a96e0f54340 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]). {{(pid=84206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 30 11:07:57 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD" returned: 0 in 0.911s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 is fetched for user 75299e77acf84c0286e44574b1c75840. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:07:57 devstack cinder-volume[84206]: INFO cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0f49e4-4d77-41e7-97ff-c0dbc0b0f9f2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab03c1-b2d8-41a9-9775-2c117d6dd3e6]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:57 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD Apr 30 11:07:57 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:57 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD Apr 30 11:07:57 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:57 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 1073741824" returned: 0 in 1.060s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ec2af5ec-11f6-4a86-a0ad-fd4a790240e6 tempest-GroupSnapshotsTest-1286308054 None] Update group completed successfully. Apr 30 11:07:58 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 Apr 30 11:07:58 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:58 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:58 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD" returned: 0 in 0.888s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 is fetched for user ecdab2bdf85b474a88581eac50d7527a. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d546c1-d970-4a46-8c1d-3b03795b6943]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:58 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6" returned: 0 in 0.689s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.228s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-255250422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41038b4-4b95-4d71-bb8a-bba073ad5f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c481608d554410a5f35f5bc16ea7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:55Z,use_quota=True,user_id='75299e77acf84c0286e44574b1c75840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Creating volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:07:58 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:58 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD Apr 30 11:07:58 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:58 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1073741824 Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e022610e-3bd6-4849-b35c-d1744f2f0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1394d33b-cb0a-4dfe-89be-374f043abea6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:58 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876904d8-483e-4f2a-80a5-b05f6ee50793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:07:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Volume volume-1394d33b-cb0a-4dfe-89be-374f043abea6 (1394d33b-cb0a-4dfe-89be-374f043abea6): created successfully Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (876904d8-483e-4f2a-80a5-b05f6ee50793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:07:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Flow 'volume_create_manager' (a5c6e1b1-c45d-4467-a63a-2ccf6e5e9fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:07:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-68f7e48f-2130-4df2-982c-7d4bf5e6dd8f tempest-VolumeQuotasNegativeTestJSON-94358614 None] Created volume successfully. Apr 30 11:07:59 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c1318cd9-2f3b-46dc-877a-f6bebd35ec59 tempest-GroupSnapshotsTest-1286308054 None] Update group completed successfully. Apr 30 11:07:59 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:07:59 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 30 11:07:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1073741824" returned: 0 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:07:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:07:59 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:07:59 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 0 in 0.690s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:07:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea89cba8-05c7-4e34-b7e5-800414e6b643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194b58baa879465c826ef22634233cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:07:56Z,use_quota=True,user_id='ecdab2bdf85b474a88581eac50d7527a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Creating volume ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:00 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:00 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1073741824 Apr 30 11:08:00 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Attempting download of 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:08:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3e3ed89a-bcf8-4e5f-810c-b074aca5b142 tempest-GroupSnapshotsTest-1286308054 None] Update group completed successfully. Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e74108-f0db-4e04-bfc8-3134660135b4]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:00 devstack sudo[87957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w Apr 30 11:08:00 devstack sudo[87957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Acquiring lock "cinder-1394d33b-cb0a-4dfe-89be-374f043abea6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "cinder-1394d33b-cb0a-4dfe-89be-374f043abea6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Acquiring lock "cinder-quobyte-1394d33b-cb0a-4dfe-89be-374f043abea6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "cinder-quobyte-1394d33b-cb0a-4dfe-89be-374f043abea6" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba9b8f6-9184-4b3e-b8e4-1258d420ee1b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:00 devstack sudo[87959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 Apr 30 11:08:00 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:01 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1073741824" returned: 0 in 0.858s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:01 devstack sudo[87957]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w" returned: 0 in 0.763s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:01 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:01 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:01 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w Apr 30 11:08:01 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:01 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-03bccc14-5833-4b3a-8673-2ecc5e7abd93 tempest-GroupSnapshotsTest-1286308054 None] Update group completed successfully. Apr 30 11:08:01 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6" returned: 0 in 0.955s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:01 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6 Apr 30 11:08:01 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:01 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 0.738s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=104,cinder:UPDATE=116,cinder:INSERT=27,cinder:DELETE=7 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Attempting download of 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume ea89cba8-05c7-4e34-b7e5-800414e6b643. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe377872-b5f8-4ff2-abd5-922d43dbfa8a]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:02 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w" returned: 1 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ho8db59w' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[21547a65-3d8f-4e03-b738-23fee95acd65]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:02 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo Apr 30 11:08:02 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:02 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD Apr 30 11:08:02 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:02 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1394d33b-cb0a-4dfe-89be-374f043abea6" returned: 0 in 0.736s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "cinder-quobyte-1394d33b-cb0a-4dfe-89be-374f043abea6" released by "delete_volume" :: held 1.736s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Created reservations ['4abc659c-1ce2-4888-8789-f6e3caf3c450', 'f3a691fc-9ad2-482c-9f56-37de0484af98', '3e2b20ae-98dd-4470-a84b-8f439abf05af', 'e16041b8-f64f-4013-8b37-dbcf03298137'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=111,cinder:UPDATE=133,cinder:DELETE=9,cinder:INSERT=28 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:02 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:02 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:02 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:02 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo Apr 30 11:08:02 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:02 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD" returned: 0 in 0.914s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] 9165766b-a0b9-4919-8d55-0a96e0f54340 was qcow2, converting to raw {{(pid=84206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:03 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:03 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] GroupSnapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: creating. Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Group snapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: creating. {{(pid=84206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Creating offline snapshot 13463a19-f87b-4594-8a33-db7969c23439 of volume a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8b02d-8acf-4b8d-b4f6-dadbd8fc14a8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:03 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 Apr 30 11:08:03 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:03 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.961s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Deleted volume successfully. Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5cc8e57b-3ead-422d-98fa-4742ee830f54 tempest-VolumeQuotasNegativeTestJSON-94358614 None] Lock "cinder-1394d33b-cb0a-4dfe-89be-374f043abea6-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:03 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo" returned: 1 in 1.025s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_qvgzd0zo' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe06e9e-3c6d-42f9-b142-3418eb918184]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:03 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD Apr 30 11:08:03 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:04 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366" returned: 0 in 1.009s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:04 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 1G Apr 30 11:08:04 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:04 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:04 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] 9165766b-a0b9-4919-8d55-0a96e0f54340 was qcow2, converting to raw {{(pid=84206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:08:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:04 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:04 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:05 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 1G" returned: 0 in 1.158s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cabecd-af54-406e-9fc4-a0fed4840366 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:05 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cabecd-af54-406e-9fc4-a0fed4840366 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 Apr 30 11:08:05 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 0 in 2.758s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:05 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:05 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_k7uc4o_mdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:08:05 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Converted 112.00 MB image at 40.59 MB/s Apr 30 11:08:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:05 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1G Apr 30 11:08:05 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:06 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cabecd-af54-406e-9fc4-a0fed4840366 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439" returned: 0 in 0.956s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:06 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:06 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 Apr 30 11:08:06 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:06 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f 1G" returned: 0 in 1.065s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[653f1b33-672a-4939-8c4d-1092b1203118]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:06 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:06 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:07 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:07 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:07 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439" returned: 0 in 0.792s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:07 devstack sudo[88053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info Apr 30 11:08:07 devstack sudo[88053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:07 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 2.811s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_uj84b78udevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:08:07 devstack cinder-volume[84206]: INFO cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Converted 112.00 MB image at 39.79 MB/s Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:07 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1G Apr 30 11:08:07 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:07 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.968s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:07 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 0 in 1.088s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:08 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:08 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:08 devstack sudo[88053]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info" returned: 0 in 1.034s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:08 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:08 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info Apr 30 11:08:08 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:08 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 1G" returned: 0 in 0.793s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19775193-804b-4b4c-b573-a849f4c0409f]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:08 devstack sudo[88069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:08 devstack sudo[88069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:08 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 1 in 0.926s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Downloaded image 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f successfully. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 for user 75299e77acf84c0286e44574b1c75840 is deleted. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Marking volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f as bootable. {{(pid=84206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Copying metadata from image 9165766b-a0b9-4919-8d55-0a96e0f54340 to e41038b4-4b95-4d71-bb8a-bba073ad5f0f. {{(pid=84206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:08:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Creating volume glance metadata for volume e41038b4-4b95-4d71-bb8a-bba073ad5f0f backed by image 9165766b-a0b9-4919-8d55-0a96e0f54340 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:08:09 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.info" returned: 0 in 0.847s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.924s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Creating offline snapshot 1e716a12-adc2-44ea-9ae3-470785a9e95e of volume 4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae70bc-f8f6-4ffd-94df-ac64ecdc58a3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77dd4bc6-437c-4512-a1d8-e66358e4619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7de7b8-2246-46ed-91de-c9d45010528c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:09 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Volume volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f (e41038b4-4b95-4d71-bb8a-bba073ad5f0f): created successfully Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd7de7b8-2246-46ed-91de-c9d45010528c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Flow 'volume_create_manager' (6ee68398-aedf-4c7f-bf67-84d4b9a97a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-531de13d-a506-4b3c-a52a-14a798347d95 tempest-VolumesImageMetadata-187544188 None] Created volume successfully. Apr 30 11:08:09 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef Apr 30 11:08:09 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:09 devstack sudo[88069]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 1.017s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:09 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:09 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef" returned: 0 in 0.908s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Acquiring lock "cinder-e41038b4-4b95-4d71-bb8a-bba073ad5f0f-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:10 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e 1G Apr 30 11:08:10 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "cinder-e41038b4-4b95-4d71-bb8a-bba073ad5f0f-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Flow 'volume_create_manager' (737396b9-f28c-4751-b450-ee468a1fe208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd2f8f7-881f-458a-8abc-1bbe547024c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Acquiring lock "cinder-quobyte-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd2f8f7-881f-458a-8abc-1bbe547024c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1339063331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9151e605-6a49-46ca-a3fb-fbac5d21fda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7899df96b0640a5bfdc29d6c95c138f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:10Z,use_quota=True,user_id='3b9aab5a767d43fdaf4a1877736f4850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13a0c11-e8e8-4fb6-b539-28fe3030edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13a0c11-e8e8-4fb6-b539-28fe3030edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7deed-dd3c-49f6-9819-4b4ebc20ec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d7deed-dd3c-49f6-9819-4b4ebc20ec97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9151e605-6a49-46ca-a3fb-fbac5d21fda1', 'volume_name': 'volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ec6e4-e5af-41a2-99df-e6159e6e0402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288ec6e4-e5af-41a2-99df-e6159e6e0402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7c0225-153e-485a-b4bf-3a54ece8560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Volume 9151e605-6a49-46ca-a3fb-fbac5d21fda1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1', 'volume_size': 1} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 1 in 0.966s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Downloaded image 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume ea89cba8-05c7-4e34-b7e5-800414e6b643 successfully. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 for user ecdab2bdf85b474a88581eac50d7527a is deleted. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Marking volume ea89cba8-05c7-4e34-b7e5-800414e6b643 as bootable. {{(pid=84206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "cinder-quobyte-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" acquired by "delete_volume" :: waited 0.078s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Copying metadata from image 9165766b-a0b9-4919-8d55-0a96e0f54340 to ea89cba8-05c7-4e34-b7e5-800414e6b643. {{(pid=84206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Creating volume glance metadata for volume ea89cba8-05c7-4e34-b7e5-800414e6b643 backed by image 9165766b-a0b9-4919-8d55-0a96e0f54340 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fafcad-d874-4e12-8086-b8f12da76f40]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb130839-f383-441f-a848-24aede10fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea89cba8-05c7-4e34-b7e5-800414e6b643', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d83ee5-fd88-41ad-85e9-a3b58dd33eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Volume volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 (ea89cba8-05c7-4e34-b7e5-800414e6b643): created successfully Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d83ee5-fd88-41ad-85e9-a3b58dd33eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Flow 'volume_create_manager' (e08991f2-bf67-4a6e-b9bb-ea7a1460f225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-f2b9428a-c84b-453b-8ebc-94cde4e5bad0 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Created volume successfully. Apr 30 11:08:10 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:10 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:10 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e 1G" returned: 0 in 0.872s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d165cd5-90c7-4fab-b438-1c336eef2eef -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:10 devstack sudo[88094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d165cd5-90c7-4fab-b438-1c336eef2eef -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e Apr 30 11:08:10 devstack sudo[88094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:11 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 0 in 0.805s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:11 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:11 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:11 devstack sudo[88094]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d165cd5-90c7-4fab-b438-1c336eef2eef -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e" returned: 0 in 0.688s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:11 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:11 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e Apr 30 11:08:11 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:11 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 1 in 0.737s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:11 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f Apr 30 11:08:11 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:12 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e" returned: 0 in 0.622s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:12 devstack sudo[88119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info Apr 30 11:08:12 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:12 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" returned: 0 in 0.614s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "cinder-quobyte-e41038b4-4b95-4d71-bb8a-bba073ad5f0f" released by "delete_volume" :: held 2.241s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Created reservations ['d89ee4bc-1aa9-465f-b62b-ae48241a3097', '34965a2c-5c48-4344-a596-17d28df06529', 'c8c366aa-893e-4e6d-bc3c-3b589fae049f', '99f2fb62-ab86-4d19-92fe-fc4054f0fd9a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:12 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:12 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:12 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info" returned: 0 in 0.667s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:12 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:12 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info Apr 30 11:08:12 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:13 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.666s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Deleted volume successfully. Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b9aba509-b806-4c56-a356-14ac00493eae tempest-VolumesImageMetadata-187544188 None] Lock "cinder-e41038b4-4b95-4d71-bb8a-bba073ad5f0f-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:13 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.info" returned: 0 in 0.587s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.237s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1339063331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9151e605-6a49-46ca-a3fb-fbac5d21fda1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7899df96b0640a5bfdc29d6c95c138f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:10Z,use_quota=True,user_id='3b9aab5a767d43fdaf4a1877736f4850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Creating volume 9151e605-6a49-46ca-a3fb-fbac5d21fda1 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:13 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:13 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 1073741824 Apr 30 11:08:13 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4062fc71-332c-4f33-8c38-7e60b33d49d7 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: created successfully Apr 30 11:08:14 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 1073741824" returned: 0 in 0.946s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:14 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 Apr 30 11:08:14 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: deleting Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: deleting {{(pid=84206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-13463a19-f87b-4594-8a33-db7969c23439" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-13463a19-f87b-4594-8a33-db7969c23439" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Deleting offline snapshot 13463a19-f87b-4594-8a33-db7969c23439 of volume a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] snapshot_file for this snap is: volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c9d46-39fa-487c-ab05-563874ec9791]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:15 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 Apr 30 11:08:15 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:15 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1" returned: 0 in 0.743s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.081s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7c0225-153e-485a-b4bf-3a54ece8560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d4f30-c375-49a6-a2eb-37f84d1cf2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:15 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Volume volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 (9151e605-6a49-46ca-a3fb-fbac5d21fda1): created successfully Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90d4f30-c375-49a6-a2eb-37f84d1cf2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Flow 'volume_create_manager' (737396b9-f28c-4751-b450-ee468a1fe208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0774b41f-c6ac-4a01-909b-9a0a4868cd9c]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ff52ae8b-d48b-40ef-ae89-a28da6deb5b8 tempest-VolumesServicesTestJSON-93091520 None] Created volume successfully. Apr 30 11:08:15 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:15 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Acquiring lock "cinder-9151e605-6a49-46ca-a3fb-fbac5d21fda1-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "cinder-9151e605-6a49-46ca-a3fb-fbac5d21fda1-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Acquiring lock "cinder-quobyte-9151e605-6a49-46ca-a3fb-fbac5d21fda1" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "cinder-quobyte-9151e605-6a49-46ca-a3fb-fbac5d21fda1" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41d36d-43a6-49cf-8c89-e2096c2d2991]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:16 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 Apr 30 11:08:16 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:16 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439" returned: 0 in 0.970s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cabecd-af54-406e-9fc4-a0fed4840366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1794bdf-ff84-4e80-9b05-105f0f46acf0]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:16 devstack sudo[88148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 Apr 30 11:08:16 devstack sudo[88148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:16 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 1.000s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:16 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:16 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:16 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1" returned: 0 in 0.921s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:16 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1 Apr 30 11:08:16 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:17 devstack sudo[88148]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366" returned: 0 in 0.849s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:17 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 Apr 30 11:08:17 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:17 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 1 in 0.992s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.063s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085', 'name': 'volume-ea89cba8-05c7-4e34-b7e5-800414e6b643', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c293763-93bd-4815-a7bf-301c06b75c11', 'enforce_multipath': True} {{(pid=84206) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 30 11:08:17 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-6c93ae83-8e1e-4e6b-af8b-4f9616e5cf51 req-b0e29407-57af-4247-9699-30927150ac67 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] attachment_update completed successfully. Apr 30 11:08:17 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9151e605-6a49-46ca-a3fb-fbac5d21fda1" returned: 0 in 0.745s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "cinder-quobyte-9151e605-6a49-46ca-a3fb-fbac5d21fda1" released by "delete_volume" :: held 1.714s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Created reservations ['dc7107fb-0adf-427b-adec-c5c7b7cb7139', '22f5e250-4f36-45b3-8c22-f933727ab007', 'a90a237e-aa99-4ab1-b6d5-36a907536be5', '441f9bff-1c82-4343-bd76-5ac362985fb8'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:17 devstack sudo[88172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:17 devstack sudo[88172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:17 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439" returned: 0 in 0.946s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:18 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439 Apr 30 11:08:18 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:18 devstack sudo[88172]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.800s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:18 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Deleted volume successfully. Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-66b5a41e-7275-4439-be6e-55bd4f5b0233 tempest-VolumesServicesTestJSON-93091520 None] Lock "cinder-9151e605-6a49-46ca-a3fb-fbac5d21fda1-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:18 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366.13463a19-f87b-4594-8a33-db7969c23439" returned: 0 in 0.861s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-13463a19-f87b-4594-8a33-db7969c23439" released by "_delete_snapshot" :: held 3.766s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" released by "delete_snapshot" :: held 3.799s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-1e716a12-adc2-44ea-9ae3-470785a9e95e" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-1e716a12-adc2-44ea-9ae3-470785a9e95e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Deleting offline snapshot 1e716a12-adc2-44ea-9ae3-470785a9e95e of volume 4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] snapshot_file for this snap is: volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:19 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c0821-34ee-4ea4-88ee-799b3c5030f6]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:19 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e Apr 30 11:08:19 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:19 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e" returned: 0 in 0.984s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d165cd5-90c7-4fab-b438-1c336eef2eef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2733075c-a81b-4da9-a403-a4a3a697ac1a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:20 devstack sudo[88184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef Apr 30 11:08:20 devstack sudo[88184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (dbf9b45b-cd4f-4509-99e1-c946783216f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348c4a65-cb1f-4ff4-84dd-2cc39117104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (348c4a65-cb1f-4ff4-84dd-2cc39117104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-830524979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ced222c-d212-453d-8e33-7c8cee1ca970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845c1efabce24002982791c34449bd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:20Z,use_quota=True,user_id='a9c85a6976b6434c8161f2865e511777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b32ac-85d2-4d5b-9c25-9b9fe19189b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0b32ac-85d2-4d5b-9c25-9b9fe19189b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9c1da-1b90-446b-8273-047fbd3f418c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea9c1da-1b90-446b-8273-047fbd3f418c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ced222c-d212-453d-8e33-7c8cee1ca970', 'volume_name': 'volume-8ced222c-d212-453d-8e33-7c8cee1ca970', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cff5d4-17a4-41eb-9a4a-3fc9fa88556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cff5d4-17a4-41eb-9a4a-3fc9fa88556e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3df38e-b4d2-4ce0-baa0-ea06515c8b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Volume 8ced222c-d212-453d-8e33-7c8cee1ca970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ced222c-d212-453d-8e33-7c8cee1ca970', 'volume_size': 1} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-830524979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ced222c-d212-453d-8e33-7c8cee1ca970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845c1efabce24002982791c34449bd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:20Z,use_quota=True,user_id='a9c85a6976b6434c8161f2865e511777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Creating volume 8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:20 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:20 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 1073741824 Apr 30 11:08:20 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:21 devstack sudo[88184]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef" returned: 0 in 0.968s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:21 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e Apr 30 11:08:21 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:21 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 1073741824" returned: 0 in 1.047s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:21 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 Apr 30 11:08:21 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:21 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e" returned: 0 in 0.939s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:21 devstack sudo[88205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e Apr 30 11:08:21 devstack sudo[88205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:22 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970" returned: 0 in 0.695s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3df38e-b4d2-4ce0-baa0-ea06515c8b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ced222c-d212-453d-8e33-7c8cee1ca970', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d90d51-af37-4b54-a431-f68988eabd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:22 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Volume volume-8ced222c-d212-453d-8e33-7c8cee1ca970 (8ced222c-d212-453d-8e33-7c8cee1ca970): created successfully Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d90d51-af37-4b54-a431-f68988eabd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (dbf9b45b-cd4f-4509-99e1-c946783216f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b4a6344b-70e7-415f-9825-5015ca469ce9 tempest-VolumesDeleteCascade-1088091563 None] Created volume successfully. Apr 30 11:08:23 devstack sudo[88205]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef.1e716a12-adc2-44ea-9ae3-470785a9e95e" returned: 0 in 1.077s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-1e716a12-adc2-44ea-9ae3-470785a9e95e" released by "_delete_snapshot" :: held 4.150s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" released by "delete_snapshot" :: held 4.183s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Creating offline snapshot f49996a0-7897-4126-b821-f02994d0990b of volume 8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c42a7-32ea-4db7-85ee-2df61ffa0e34]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:23 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1269698950 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1269698950, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:23 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1269698950 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1269698950, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['521a04aa-8da7-4203-850d-9d83ca972ab2', '8924d44d-cc41-41b7-b5ee-b43d1c020cd9', '5e32f0f1-7af6-4365-a9cc-9de9b35c0f15', '6aeb7bc5-832e-4477-abc1-7c13d8d018fd'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:23 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 Apr 30 11:08:23 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['4179013a-5a9e-4e7a-a525-306d4e20b414', '018ae33e-7470-45cb-9008-42935fe809f0', 'a0d2791a-e19f-4565-9ac5-c42660b9fc2a', 'bb8f57c3-1ace-45bb-83c3-cc4443ed4bd1'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:23 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f096df70-4927-481f-a183-fc62e4fc3f55 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot a06594ea-b04e-4910-ad91-b1d28b8dd833: deleted successfully Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" acquired by "delete_volume" :: waited 0.040s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6702ce5-29fe-463a-b974-dc284ee141e8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:24 devstack sudo[88253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef Apr 30 11:08:24 devstack sudo[88253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:24 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970" returned: 0 in 1.154s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:24 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b 1G Apr 30 11:08:24 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:25 devstack sudo[88253]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef" returned: 0 in 1.097s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:25 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef Apr 30 11:08:25 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:25 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b 1G" returned: 0 in 1.575s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:26 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:26 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Flow 'volume_create_manager' (83a99977-2920-4d4c-bdc4-1bcc2c12b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea16ebeb-ba79-402a-9cd1-acdadfcf708b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea16ebeb-ba79-402a-9cd1-acdadfcf708b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1025749834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbdd8aa0b64af4ad49796ac8abe2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:26Z,use_quota=True,user_id='f7ba5af922ed4f01a5a2dd1f509b5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e4bb8-d8fe-481f-8cfd-afa19a33c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e4bb8-d8fe-481f-8cfd-afa19a33c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807871ab-7abb-4ee7-9a56-09aa8c94c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807871ab-7abb-4ee7-9a56-09aa8c94c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e', 'volume_name': 'volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031f0caf-e17a-450e-8f1f-89cb367548e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (031f0caf-e17a-450e-8f1f-89cb367548e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f6901e-70e4-43d7-ba6d-9605d8631310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Volume 3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e', 'volume_size': 1} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:26 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d165cd5-90c7-4fab-b438-1c336eef2eef" returned: 0 in 1.138s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-4d165cd5-90c7-4fab-b438-1c336eef2eef" released by "delete_volume" :: held 2.363s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e06744-fca7-40b4-89a2-4099e33d9f29]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:26 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 Apr 30 11:08:26 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:27 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 1.185s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:27 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b is being set with open permissions: ugo+rw Apr 30 11:08:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:27 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:27 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:27 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366" returned: 0 in 1.018s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:27 devstack sudo[88281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366 Apr 30 11:08:27 devstack sudo[88281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:27 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 0.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:28 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info Apr 30 11:08:28 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:28 devstack sudo[88281]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a2cabecd-af54-406e-9fc4-a0fed4840366" returned: 0 in 0.895s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-a2cabecd-af54-406e-9fc4-a0fed4840366" released by "delete_volume" :: held 2.035s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['313120c2-5663-43b1-a1c5-3835098a7cab'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:28 devstack cinder-volume[84206]: WARNING cinder.quota [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1269698950 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1269698950, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['af5c574e-b5e8-4089-80cf-b15ea65c5a85', 'f06d6faa-e89a-49a5-846a-d3faab89feb2', 'a743c1ca-265c-45bb-9973-36b8da2fa3e4', 'df5915e2-9e04-4596-86c8-f0a049ba2263'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['99919a82-7f73-4ed4-914a-861fc5aa3ef6', '88bb23fd-f7e8-49b1-a518-0aa3dfad1ed7', 'fa914e9f-a594-4ca8-9d7f-1d8526dc8946', '510b4186-501d-41db-a260-25b208391d72'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:28 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info" returned: 0 in 0.836s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:28 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info is being set with open permissions: ugo+rw Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:28 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info Apr 30 11:08:28 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:28 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:28 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:29 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.info" returned: 0 in 0.812s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.569s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.332s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1025749834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74fbdd8aa0b64af4ad49796ac8abe2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:26Z,use_quota=True,user_id='f7ba5af922ed4f01a5a2dd1f509b5595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Creating volume 3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:29 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:29 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e 1073741824 Apr 30 11:08:29 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e6529fde-5f21-4d7f-8526-7f0b3cb76ec1 tempest-VolumesDeleteCascade-1088091563 None] Create snapshot completed successfully Apr 30 11:08:30 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.034s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:30 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ca361f2d-cf64-4694-90ff-c812639f68d0 tempest-GroupSnapshotsTest-1286308054 None] Delete group completed successfully. Apr 30 11:08:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2f164358-462d-4425-8054-8c1e52a2acca tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-1345498481: creating Apr 30 11:08:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2f164358-462d-4425-8054-8c1e52a2acca tempest-GroupSnapshotsTest-1286308054 None] Group tempest-GroupSnapshotsTest-Group-1345498481: created successfully Apr 30 11:08:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2f164358-462d-4425-8054-8c1e52a2acca tempest-GroupSnapshotsTest-1286308054 None] Create group completed successfully. Apr 30 11:08:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:31 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e 1073741824" returned: 0 in 1.369s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:31 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e Apr 30 11:08:31 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:31 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" returned: 0 in 0.715s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.876s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f6901e-70e4-43d7-ba6d-9605d8631310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e763b49-3e26-4045-a387-d13e9f7b3d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Creating offline snapshot 713a54e3-6ad8-4a19-a521-c3126c30445a of volume 8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Volume volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e (3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e): created successfully Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e763b49-3e26-4045-a387-d13e9f7b3d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Flow 'volume_create_manager' (83a99977-2920-4d4c-bdc4-1bcc2c12b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc5b580-bc6f-434c-8b81-1c57ebce511a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-666b335a-16f3-456e-b2db-8cdec9df9725 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Created volume successfully. Apr 30 11:08:32 devstack sudo[88313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:32 devstack sudo[88313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (cdfa86af-803f-4dae-ad38-3b4d2b651d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9181c583-ff25-4a76-a9e1-7809bf6ad2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9181c583-ff25-4a76-a9e1-7809bf6ad2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1152479257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6224407c-0c1d-45b2-afc7-1f05c268ca80,host='devstack@QuobyteHD#QuobyteHD',id=79384f7e-0018-453f-a3c1-caf4a51106e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:32Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87000c79-d9fa-46cf-929f-00a223941452),volume_type_id=87000c79-d9fa-46cf-929f-00a223941452)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bec0b9c-9758-464e-955b-b8eb802c4f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bec0b9c-9758-464e-955b-b8eb802c4f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407c1c2f-106e-4e8f-b3db-d7675b0c9f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407c1c2f-106e-4e8f-b3db-d7675b0c9f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79384f7e-0018-453f-a3c1-caf4a51106e7', 'volume_name': 'volume-79384f7e-0018-453f-a3c1-caf4a51106e7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a5e271-9afe-4b5a-8d7c-7fd12ebaa852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a5e271-9afe-4b5a-8d7c-7fd12ebaa852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8234d53-354a-4dda-b81c-97b3bf0757e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Volume 79384f7e-0018-453f-a3c1-caf4a51106e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79384f7e-0018-453f-a3c1-caf4a51106e7', 'volume_size': 1} Apr 30 11:08:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:33 devstack sudo[88313]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 1.102s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ced222c-d212-453d-8e33-7c8cee1ca970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:33 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a 1G Apr 30 11:08:33 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:34 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a 1G" returned: 0 in 0.963s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:34 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a Apr 30 11:08:34 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:34 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a" returned: 0 in 0.661s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:34 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a is being set with open permissions: ugo+rw Apr 30 11:08:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:34 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a Apr 30 11:08:34 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:35 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a" returned: 0 in 0.577s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.517s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.685s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6224407c-0c1d-45b2-afc7-1f05c268ca80,created_at=2026-04-30T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1152479257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6224407c-0c1d-45b2-afc7-1f05c268ca80,host='devstack@QuobyteHD#QuobyteHD',id=79384f7e-0018-453f-a3c1-caf4a51106e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88372b8ac2b445bfb166d2edb3c3cd69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:32Z,use_quota=True,user_id='5757639db601496b9e5c9c300ae5255b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87000c79-d9fa-46cf-929f-00a223941452),volume_type_id=87000c79-d9fa-46cf-929f-00a223941452)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Creating volume 79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:35 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:35 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 1073741824 Apr 30 11:08:35 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-80cf5973-cb34-4826-9180-d9b736d9943b tempest-VolumesDeleteCascade-1088091563 None] Create snapshot completed successfully Apr 30 11:08:36 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 1073741824" returned: 0 in 0.823s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:36 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-8ced222c-d212-453d-8e33-7c8cee1ca970-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:36 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-8ced222c-d212-453d-8e33-7c8cee1ca970-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Performing cascade delete. {{(pid=84206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-713a54e3-6ad8-4a19-a521-c3126c30445a-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-713a54e3-6ad8-4a19-a521-c3126c30445a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-713a54e3-6ad8-4a19-a521-c3126c30445a" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-713a54e3-6ad8-4a19-a521-c3126c30445a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Deleting offline snapshot 713a54e3-6ad8-4a19-a521-c3126c30445a of volume 8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] snapshot_file for this snap is: volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea8161-1b03-41aa-b54f-fe1b5540d8be]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:36 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a Apr 30 11:08:36 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:36 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7" returned: 0 in 0.690s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.907s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Creating offline snapshot 91641ec8-ae27-4e6a-83d3-d2002c0b399f of volume 3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8234d53-354a-4dda-b81c-97b3bf0757e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79384f7e-0018-453f-a3c1-caf4a51106e7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b516083-9743-48f0-8c2f-d84d7cc94c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aab5c8-b79e-4c5c-99de-e87eb746a40e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Volume volume-79384f7e-0018-453f-a3c1-caf4a51106e7 (79384f7e-0018-453f-a3c1-caf4a51106e7): created successfully Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b516083-9743-48f0-8c2f-d84d7cc94c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Flow 'volume_create_manager' (cdfa86af-803f-4dae-ad38-3b4d2b651d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-fd6377c8-5be2-4759-93e4-18d8c04ea1b4 tempest-GroupSnapshotsTest-1286308054 None] Created volume successfully. Apr 30 11:08:37 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e Apr 30 11:08:37 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:37 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a" returned: 0 in 0.811s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ced222c-d212-453d-8e33-7c8cee1ca970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[747c9bb0-d32e-430c-b9de-4466d3eb7774]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:37 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:37 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:37 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" returned: 0 in 0.787s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:37 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f 1G Apr 30 11:08:37 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:38 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 0.779s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ced222c-d212-453d-8e33-7c8cee1ca970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:38 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a Apr 30 11:08:38 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] GroupSnapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: creating. Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Group snapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: creating. {{(pid=84206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:38 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f 1G" returned: 0 in 0.859s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:38 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f Apr 30 11:08:38 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:39 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a" returned: 0 in 1.033s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:39 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a Apr 30 11:08:39 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:39 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f" returned: 0 in 1.260s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:39 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f is being set with open permissions: ugo+rw Apr 30 11:08:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:39 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f Apr 30 11:08:39 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:40 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.713a54e3-6ad8-4a19-a521-c3126c30445a" returned: 0 in 1.013s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-713a54e3-6ad8-4a19-a521-c3126c30445a" released by "_delete_snapshot" :: held 3.756s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" released by "delete_snapshot" :: held 3.779s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['ee45d499-2c1c-4176-a69e-e00a1e1c8292', '5ef21e9c-de8e-4747-ab88-561e9ca3db11', '39daa366-159a-42e3-903b-410383cf0742', 'd1098730-967d-421b-80c9-14f6f5c8a1f5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Delete snapshot completed successfully. Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-713a54e3-6ad8-4a19-a521-c3126c30445a-delete_snapshot" released by "delete_snapshot" :: held 3.952s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-f49996a0-7897-4126-b821-f02994d0990b-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-f49996a0-7897-4126-b821-f02994d0990b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-f49996a0-7897-4126-b821-f02994d0990b" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-f49996a0-7897-4126-b821-f02994d0990b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Deleting offline snapshot f49996a0-7897-4126-b821-f02994d0990b of volume 8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] snapshot_file for this snap is: volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[59478375-6916-4095-b3f7-72b0582660a2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:40 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:40 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:40 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f" returned: 0 in 0.838s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:40 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info Apr 30 11:08:40 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:41 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 1.326s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ced222c-d212-453d-8e33-7c8cee1ca970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608f10c-fd70-42d1-825d-174f4bf4bd7b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:41 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info" returned: 0 in 1.097s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:41 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info is being set with open permissions: ugo+rw Apr 30 11:08:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:41 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info Apr 30 11:08:41 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:42 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 Apr 30 11:08:42 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:42 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.info" returned: 0 in 0.719s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.699s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.203s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Creating offline snapshot 3cb40a40-0fe2-4d6f-98f5-ab52d2949394 of volume 79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-82c8d49c-5e9d-409f-b9a1-c06608275a20 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Create snapshot completed successfully Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed6d7c-4ff0-4cbe-b831-4b3dfaabccbd]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:42 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970" returned: 0 in 0.916s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:42 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:42 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:42 devstack sudo[88544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 Apr 30 11:08:42 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:43 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7" returned: 0 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:43 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 1G Apr 30 11:08:43 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:43 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 1.000s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:43 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b Apr 30 11:08:43 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "cinder-91641ec8-ae27-4e6a-83d3-d2002c0b399f-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-91641ec8-ae27-4e6a-83d3-d2002c0b399f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "cinder-quobyte-91641ec8-ae27-4e6a-83d3-d2002c0b399f" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-91641ec8-ae27-4e6a-83d3-d2002c0b399f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Deleting offline snapshot 91641ec8-ae27-4e6a-83d3-d2002c0b399f of volume 3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] snapshot_file for this snap is: volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[128b0b2e-797a-4bf7-bd45-c037678ee274]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:44 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f Apr 30 11:08:44 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:44 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 1G" returned: 0 in 1.145s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79384f7e-0018-453f-a3c1-caf4a51106e7 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:44 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79384f7e-0018-453f-a3c1-caf4a51106e7 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 Apr 30 11:08:44 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:44 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970.f49996a0-7897-4126-b821-f02994d0990b" returned: 0 in 1.064s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-f49996a0-7897-4126-b821-f02994d0990b" released by "_delete_snapshot" :: held 4.522s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" released by "delete_snapshot" :: held 4.565s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['5d8a79a7-d681-4272-92ca-b638e0871599', '4d6e235e-01d5-45f9-aa96-83082c556fc2', '182eea0d-cd8c-4046-9947-532b204fa0a8', 'ab160abe-5dd4-4bbb-9bec-1187c1d8f110'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Delete snapshot completed successfully. Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-f49996a0-7897-4126-b821-f02994d0990b-delete_snapshot" released by "delete_snapshot" :: held 4.951s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Snapshots deleted, issuing volume delete {{(pid=84206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:45 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f" returned: 0 in 1.070s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" acquired by "delete_volume" :: waited 0.090s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e7023-fdb1-413c-aa83-b8c3710fb339]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3076b69-eec0-44be-a880-ca8375124822]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:45 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 Apr 30 11:08:45 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:45 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e Apr 30 11:08:45 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:45 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79384f7e-0018-453f-a3c1-caf4a51106e7 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394" returned: 0 in 1.162s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:45 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:45 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 Apr 30 11:08:45 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:46 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970" returned: 0 in 1.081s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:46 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" returned: 0 in 1.116s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:46 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970 Apr 30 11:08:46 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:46 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f Apr 30 11:08:46 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:46 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394" returned: 0 in 1.024s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info Apr 30 11:08:47 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:47 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8ced222c-d212-453d-8e33-7c8cee1ca970" returned: 0 in 0.857s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-8ced222c-d212-453d-8e33-7c8cee1ca970" released by "delete_volume" :: held 2.068s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['bd28cd28-d1ae-4215-a78d-dd8ee6485b0a', 'c38f4d05-336b-4593-b1e4-51f327792ffd', '82beb4fd-c94c-4485-b467-513701a26938', 'faac8a07-fef2-4d3d-b131-1c2347505a2e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:47 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f" returned: 0 in 0.987s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f Apr 30 11:08:47 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:47 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:47 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info" returned: 0 in 0.945s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:47 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:08:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:47 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info Apr 30 11:08:47 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:48 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e.91641ec8-ae27-4e6a-83d3-d2002c0b399f" returned: 0 in 1.132s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:48 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.148s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-91641ec8-ae27-4e6a-83d3-d2002c0b399f" released by "_delete_snapshot" :: held 4.621s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Deleted volume successfully. Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" released by "delete_snapshot" :: held 4.665s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-210286a0-ba10-4201-b754-3379e779f693 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-8ced222c-d212-453d-8e33-7c8cee1ca970-delete_volume" released by "delete_volume" :: held 12.566s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Created reservations ['46622fa1-42cb-4478-8cc8-b5de1a724fb4', 'e0a4f2a6-e3dd-49c1-b36a-7e8062a89d7a', '98301c3d-5bc0-4dfa-97ed-86c1713e1081', '1e3208f5-525b-45f8-9a19-b22965675d45'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Delete snapshot completed successfully. Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-04c33882-6588-4eff-925c-d926f8b1ce28 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-91641ec8-ae27-4e6a-83d3-d2002c0b399f-delete_snapshot" released by "delete_snapshot" :: held 5.007s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:49 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.info" returned: 0 in 1.239s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.544s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c9cf27ad-d4eb-44c9-8582-083d8dd3a8c4 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: created successfully Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (0d4cf2eb-bc02-4e1b-b293-dd5a1de88980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a115d8-0800-41fd-8430-ee6ecd430f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a115d8-0800-41fd-8430-ee6ecd430f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-169860623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12008f9-47c2-4f9d-bbe0-eea37600e145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845c1efabce24002982791c34449bd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:50Z,use_quota=True,user_id='a9c85a6976b6434c8161f2865e511777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5267ca-b4d2-4823-ba91-e0e49d679b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5267ca-b4d2-4823-ba91-e0e49d679b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e3f5a-6e0d-4d58-ba56-320bfc80372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60e3f5a-6e0d-4d58-ba56-320bfc80372b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12008f9-47c2-4f9d-bbe0-eea37600e145', 'volume_name': 'volume-c12008f9-47c2-4f9d-bbe0-eea37600e145', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8043f56e-7aeb-4bbf-a908-f92105e39b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8043f56e-7aeb-4bbf-a908-f92105e39b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2203a2-1ad6-4f05-84ff-e3f87d9ca706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:49 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Volume c12008f9-47c2-4f9d-bbe0-eea37600e145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12008f9-47c2-4f9d-bbe0-eea37600e145', 'volume_size': 1} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-169860623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12008f9-47c2-4f9d-bbe0-eea37600e145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845c1efabce24002982791c34449bd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:50Z,use_quota=True,user_id='a9c85a6976b6434c8161f2865e511777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Creating volume c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:49 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "cinder-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:49 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 1073741824 Apr 30 11:08:49 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d7f55-936e-442d-8e6b-a4eed29a5b86]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e Apr 30 11:08:50 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: deleting Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: deleting {{(pid=84206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-3cb40a40-0fe2-4d6f-98f5-ab52d2949394" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-3cb40a40-0fe2-4d6f-98f5-ab52d2949394" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Deleting offline snapshot 3cb40a40-0fe2-4d6f-98f5-ab52d2949394 of volume 79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] snapshot_file for this snap is: volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43af27a5-c24e-4143-be38-5bd1e94e0b1e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 Apr 30 11:08:50 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:50 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 1073741824" returned: 0 in 1.050s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" returned: 0 in 0.964s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:50 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:08:50 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:50 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e Apr 30 11:08:50 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:51 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394" returned: 0 in 0.837s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79384f7e-0018-453f-a3c1-caf4a51106e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0a70b9-5b08-4062-b9d0-9a8b777ca735]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:51 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2203a2-1ad6-4f05-84ff-e3f87d9ca706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12008f9-47c2-4f9d-bbe0-eea37600e145', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6870a56-4c4d-48c3-8e0f-7cbc565eb954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:51 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" returned: 0 in 0.838s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:51 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Volume volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 (c12008f9-47c2-4f9d-bbe0-eea37600e145): created successfully Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6870a56-4c4d-48c3-8e0f-7cbc565eb954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (0d4cf2eb-bc02-4e1b-b293-dd5a1de88980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-quobyte-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e" released by "delete_volume" :: held 1.905s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:51 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 Apr 30 11:08:51 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9a97dfa0-5c86-41be-9a63-bd9887f27ead tempest-VolumesDeleteCascade-1088091563 None] Created volume successfully. Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Created reservations ['d130971f-e510-4529-8cf6-478ce43001dc', 'dc62f2b4-49bc-49b6-94a9-50c599ad6648', '5343b611-fd4b-4cd3-a430-896266b826cd', 'f516b9fa-f142-469e-b41e-5182999eaef1'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:52 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:52 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:52 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7" returned: 0 in 0.891s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:52 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 Apr 30 11:08:52 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:52 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.675s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Deleted volume successfully. Apr 30 11:08:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-8f51c18e-4c23-4846-b9c3-812c91b73c81 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Terminate volume connection completed successfully. Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-8f51c18e-4c23-4846-b9c3-812c91b73c81 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Deleting attachment 2c293763-93bd-4815-a7bf-301c06b75c11. {{(pid=84206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:08:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-41ae2d33-b8c2-4de1-a0d4-2185dfa61d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-405742349 None] Lock "cinder-3e8df7bd-c8c7-47d8-b8a6-c0aa6889518e-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Creating offline snapshot 7c03b5e8-90f6-4155-8f42-bc665f7f0e8c of volume c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f51c48-6f9e-4628-8fad-f30b02ae24bf]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:53 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:08:53 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "cinder-ea89cba8-05c7-4e34-b7e5-800414e6b643-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:53 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-ea89cba8-05c7-4e34-b7e5-800414e6b643-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394" returned: 0 in 0.921s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:53 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394 Apr 30 11:08:53 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "cinder-quobyte-ea89cba8-05c7-4e34-b7e5-800414e6b643" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-quobyte-ea89cba8-05c7-4e34-b7e5-800414e6b643" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d135a4-3e49-439f-aae2-20a358ed59d6]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:53 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:53 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:54 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 1.078s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:54 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c 1G Apr 30 11:08:54 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:54 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7.3cb40a40-0fe2-4d6f-98f5-ab52d2949394" returned: 0 in 0.920s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-3cb40a40-0fe2-4d6f-98f5-ab52d2949394" released by "_delete_snapshot" :: held 3.757s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" released by "delete_snapshot" :: held 3.789s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:54 devstack cinder-volume[84206]: WARNING cinder.quota [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-177440639 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-177440639, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:54 devstack cinder-volume[84206]: WARNING cinder.quota [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-177440639 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-177440639, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['ee405acb-92a7-4c4b-a2ca-12fc2a4f685e', 'a3c4d60a-1e04-4ea9-8d23-adcd19371e61', '5e949694-a3f0-4418-bac5-4409d37f0c4e', '814acdab-3ffe-4bf7-adcb-6c911920e4c8'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7d2c3b7e-c336-4853-9f6d-8f93f43632e2 tempest-GroupSnapshotsTest-1286308054 None] group_snapshot c3c1564d-092f-443e-b8d1-feb1eb0d0334: deleted successfully Apr 30 11:08:54 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 1.030s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:54 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:54 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:08:55 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 1 in 0.822s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2941043-3929-47ae-bf3d-5bcdf29dad83]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:55 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643 Apr 30 11:08:55 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:55 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c 1G" returned: 0 in 1.272s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:55 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:08:55 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:55 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 Apr 30 11:08:55 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:56 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ea89cba8-05c7-4e34-b7e5-800414e6b643" returned: 0 in 0.834s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-quobyte-ea89cba8-05c7-4e34-b7e5-800414e6b643" released by "delete_volume" :: held 2.786s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:56 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.832s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:56 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c is being set with open permissions: ugo+rw Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG cinder.quota [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Created reservations ['ea80fc2b-516b-47d2-8316-657bab144584', '6ad6e942-a182-4a9e-b7a8-594cc305a01b', '27462fe5-4021-4ca8-a870-20d8e099606a', 'c74676b5-1a73-4ba7-9d5e-af36a39fced3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:56 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:08:56 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:56 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:56 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:56 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7" returned: 0 in 1.154s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:56 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7 Apr 30 11:08:56 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:57 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.875s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:57 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info Apr 30 11:08:57 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:57 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.021s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG cinder.manager [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:57 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Deleted volume successfully. Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-a61a211a-517e-493e-88a1-d2ce4313b057 req-81b4927d-073b-464b-80a5-6ca8f1454276 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-ea89cba8-05c7-4e34-b7e5-800414e6b643-delete_volume" released by "delete_volume" :: held 4.224s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:57 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-79384f7e-0018-453f-a3c1-caf4a51106e7" returned: 0 in 1.014s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Lock "cinder-quobyte-79384f7e-0018-453f-a3c1-caf4a51106e7" released by "delete_volume" :: held 2.309s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['70b8e60a-2c25-4406-90b2-c03a6433e20c'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:57 devstack cinder-volume[84206]: WARNING cinder.quota [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-177440639 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-177440639, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:08:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Created reservations ['54ca2ca2-e04b-4dec-8480-4b2feeda346c', '5da1af1a-dd29-42cf-b5c5-b1ca6dcbbe65', '7b2c0d3b-f7a7-4df9-a260-da9d42b20a47', '5cc820f0-0f13-4b2d-977e-42de6bfaf2b3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Flow 'volume_create_manager' (940b8fc1-82db-4aba-8f3f-06e1e103c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9368f3-b11a-4727-b203-0a2a67ec7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9368f3-b11a-4727-b203-0a2a67ec7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1458262431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928466b6-4fbb-4c70-ae4b-b83f727f71da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f451716fbe5f4ab78cc2b7c066542adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:58Z,use_quota=True,user_id='587b40ff1eb240f492f616f390d3084b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2893c2-1d64-4042-b69a-4b1114fd3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2893c2-1d64-4042-b69a-4b1114fd3782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8c3324-2815-4076-ab21-347518652d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8c3324-2815-4076-ab21-347518652d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928466b6-4fbb-4c70-ae4b-b83f727f71da', 'volume_name': 'volume-928466b6-4fbb-4c70-ae4b-b83f727f71da', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c458a0-98b7-4491-9343-c6d9ad9ca326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c458a0-98b7-4491-9343-c6d9ad9ca326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02566742-b32e-4956-818a-cfd1b9aa5efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:08:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Volume 928466b6-4fbb-4c70-ae4b-b83f727f71da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928466b6-4fbb-4c70-ae4b-b83f727f71da', 'volume_size': 1} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:58 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info" returned: 0 in 0.832s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:58 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info is being set with open permissions: ugo+rw Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:58 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:08:58 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:58 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info Apr 30 11:08:58 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:58 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.733s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:08:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-de367563-cd27-49af-9fe1-6118495ad3b7 tempest-GroupSnapshotsTest-1286308054 None] Delete group completed successfully. Apr 30 11:08:58 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 30 11:08:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.info" returned: 0 in 0.799s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.827s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.904s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1458262431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928466b6-4fbb-4c70-ae4b-b83f727f71da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f451716fbe5f4ab78cc2b7c066542adb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:08:58Z,use_quota=True,user_id='587b40ff1eb240f492f616f390d3084b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Creating volume 928466b6-4fbb-4c70-ae4b-b83f727f71da {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:08:59 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:08:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:08:59 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da 1073741824 Apr 30 11:08:59 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:08:59 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-03438de1-cab1-49d6-9324-95ce1be34da9 tempest-VolumesDeleteCascade-1088091563 None] Create snapshot completed successfully Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:00 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da 1073741824" returned: 0 in 1.050s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (5d1c0c79-f984-41a1-adcd-c6c12f7f7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89a37b1-5964-4128-9795-9c6fbeae3168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89a37b1-5964-4128-9795-9c6fbeae3168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-885473290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5454af8a-9141-4329-b16f-0d7edcd76db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='845c1efabce24002982791c34449bd2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c03b5e8-90f6-4155-8f42-bc665f7f0e8c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:00Z,use_quota=True,user_id='a9c85a6976b6434c8161f2865e511777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac4b30e-2aaa-4ead-8af1-0c798ded8c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac4b30e-2aaa-4ead-8af1-0c798ded8c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487c3f15-d56e-4955-bdef-d5f7f78ebacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (487c3f15-d56e-4955-bdef-d5f7f78ebacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5454af8a-9141-4329-b16f-0d7edcd76db8', 'volume_name': 'volume-5454af8a-9141-4329-b16f-0d7edcd76db8', 'volume_size': 1, 'snapshot_id': '7c03b5e8-90f6-4155-8f42-bc665f7f0e8c'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbbe3a8-2cf8-4ff2-b996-dc1bc25001c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbbe3a8-2cf8-4ff2-b996-dc1bc25001c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798403e7-c138-442d-bf95-198ca4442817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:00 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Volume 5454af8a-9141-4329-b16f-0d7edcd76db8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5454af8a-9141-4329-b16f-0d7edcd76db8', 'volume_size': 1, 'snapshot_id': '7c03b5e8-90f6-4155-8f42-bc665f7f0e8c'} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:00 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da Apr 30 11:09:00 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:01 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da" returned: 0 in 0.820s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.836s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-5454af8a-9141-4329-b16f-0d7edcd76db8" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02566742-b32e-4956-818a-cfd1b9aa5efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928466b6-4fbb-4c70-ae4b-b83f727f71da', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a8a768-23b0-4885-bb10-7ca4cbadec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-5454af8a-9141-4329-b16f-0d7edcd76db8" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Creating volume 5454af8a-9141-4329-b16f-0d7edcd76db8 from snapshot 7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:01 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Volume volume-928466b6-4fbb-4c70-ae4b-b83f727f71da (928466b6-4fbb-4c70-ae4b-b83f727f71da): created successfully Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a8a768-23b0-4885-bb10-7ca4cbadec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Flow 'volume_create_manager' (940b8fc1-82db-4aba-8f3f-06e1e103c981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] snapshot: 7c03b5e8-90f6-4155-8f42-bc665f7f0e8c, volume: 5454af8a-9141-4329-b16f-0d7edcd76db8, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:09:01 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4f4be186-bf9a-4f2c-9c2f-a4435392aa30 tempest-VolumesMetadataTest-853326704 None] Created volume successfully. Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[862c6741-e4d8-4772-806a-3d8748c426d7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:01 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:09:01 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:01 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.774s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c12008f9-47c2-4f9d-bbe0-eea37600e145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03054bc-4e69-4797-b318-67f7154b3a7c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:02 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:09:02 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:02 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 0.790s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:02 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:09:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:02 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 Apr 30 11:09:02 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Acquiring lock "cinder-928466b6-4fbb-4c70-ae4b-b83f727f71da-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "cinder-928466b6-4fbb-4c70-ae4b-b83f727f71da-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=155,cinder:INSERT=48,cinder:UPDATE=143,cinder:DELETE=8 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=139,cinder:DELETE=10,cinder:INSERT=48,cinder:UPDATE=146 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Acquiring lock "cinder-quobyte-928466b6-4fbb-4c70-ae4b-b83f727f71da" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "cinder-quobyte-928466b6-4fbb-4c70-ae4b-b83f727f71da" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fbcc4-f3d2-42d1-b42b-8fd16acddc4e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:03 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da Apr 30 11:09:03 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:04 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da" returned: 0 in 1.344s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:04 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da Apr 30 11:09:04 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:06 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-928466b6-4fbb-4c70-ae4b-b83f727f71da" returned: 0 in 1.480s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "cinder-quobyte-928466b6-4fbb-4c70-ae4b-b83f727f71da" released by "delete_volume" :: held 2.905s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Created reservations ['198bb286-a23a-48eb-88bf-e30b63f20a62', '3654e370-e992-4f1d-a9b1-10c2a448d2e4', '98417edb-b9fd-472d-a31b-770732d11f8f', 'b7e3b89d-899f-41c1-b55a-393675b13901'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:06 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:06 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:07 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:07 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:08 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.840s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:08 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Deleted volume successfully. Apr 30 11:09:08 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-57c1d36a-e5ea-46e6-930c-206e9e07d2f0 tempest-VolumesMetadataTest-853326704 None] Lock "cinder-928466b6-4fbb-4c70-ae4b-b83f727f71da-delete_volume" released by "delete_volume" :: held 5.427s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-22d3b282-ca19-4467-bd3b-d8739583c6a1 tempest-GroupSnapshotsV319Test-762217778 None] Group tempest-GroupSnapshotsV319Test-Group-1809519881: creating Apr 30 11:09:09 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 2.091s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:09 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-22d3b282-ca19-4467-bd3b-d8739583c6a1 tempest-GroupSnapshotsV319Test-762217778 None] Group tempest-GroupSnapshotsV319Test-Group-1809519881: created successfully Apr 30 11:09:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-22d3b282-ca19-4467-bd3b-d8739583c6a1 tempest-GroupSnapshotsV319Test-762217778 None] Create group completed successfully. Apr 30 11:09:10 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8" returned: 0 in 7.605s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a5d2f-dfe2-4a42-ab9f-873b11e6bbe4]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:10 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:09:10 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Flow 'volume_create_manager' (9dc32568-0e08-49f9-9e67-8a5088f3dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989af39c-bf83-445f-a63b-4e655c1ce7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989af39c-bf83-445f-a63b-4e655c1ce7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552743569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1d17d2c-3241-4ffa-a774-4f2545eb848c,host='devstack@QuobyteHD#QuobyteHD',id=f48c5e64-cead-4b5e-ada9-05855256b5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb41b84487c4f7a925ba70a1fff7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:11Z,use_quota=True,user_id='f3c99bccc1c349259fa49a696dc05c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87f373d-dd54-41b9-8ec9-c4734ec945ed),volume_type_id=e87f373d-dd54-41b9-8ec9-c4734ec945ed)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b0b312-d74b-4dd3-8733-a8a8e7482141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b0b312-d74b-4dd3-8733-a8a8e7482141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47573cf-6def-4e6d-b9bf-6755fc7b491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f47573cf-6def-4e6d-b9bf-6755fc7b491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48c5e64-cead-4b5e-ada9-05855256b5ee', 'volume_name': 'volume-f48c5e64-cead-4b5e-ada9-05855256b5ee', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c4e8a6-8c4a-45a5-bbf8-82e0f8964e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c4e8a6-8c4a-45a5-bbf8-82e0f8964e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aa0eb6-b832-4e95-9a19-b77c0648be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Volume f48c5e64-cead-4b5e-ada9-05855256b5ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48c5e64-cead-4b5e-ada9-05855256b5ee', 'volume_size': 1} Apr 30 11:09:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-2bfa2271-b5e5-4148-a787-0311c459432e req-a1880505-372c-4564-b95f-76b0f527297b tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Terminate volume connection completed successfully. Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [req-2bfa2271-b5e5-4148-a787-0311c459432e req-a1880505-372c-4564-b95f-76b0f527297b tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Deleting attachment 20a22169-592c-44f3-ac2e-944d571ab02c. {{(pid=84206) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 30 11:09:11 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 1.070s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:09:11 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Converted 1024.00 MB image at 134.63 MB/s Apr 30 11:09:11 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 is being set with open permissions: ugo+rw Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:11 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 Apr 30 11:09:11 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "cinder-63ac6f56-4252-42a1-a26e-1bd60a19b520-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-63ac6f56-4252-42a1-a26e-1bd60a19b520-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "cinder-quobyte-63ac6f56-4252-42a1-a26e-1bd60a19b520" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-quobyte-63ac6f56-4252-42a1-a26e-1bd60a19b520" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69e934-dd60-4c4e-81c5-6af90b174b18]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:12 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 Apr 30 11:09:12 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:12 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8" returned: 0 in 0.726s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" released by "_copy_volume_from_snapshot" :: held 11.096s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-5454af8a-9141-4329-b16f-0d7edcd76db8" released by "_create_volume_from_snapshot" :: held 11.156s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.207s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.287s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1d17d2c-3241-4ffa-a774-4f2545eb848c,created_at=2026-04-30T09:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552743569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1d17d2c-3241-4ffa-a774-4f2545eb848c,host='devstack@QuobyteHD#QuobyteHD',id=f48c5e64-cead-4b5e-ada9-05855256b5ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb41b84487c4f7a925ba70a1fff7d29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:11Z,use_quota=True,user_id='f3c99bccc1c349259fa49a696dc05c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e87f373d-dd54-41b9-8ec9-c4734ec945ed),volume_type_id=e87f373d-dd54-41b9-8ec9-c4734ec945ed)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Creating volume f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:12 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:12 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee 1073741824 Apr 30 11:09:12 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798403e7-c138-442d-bf95-198ca4442817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5454af8a-9141-4329-b16f-0d7edcd76db8', 'volume_size': 1, 'snapshot_id': '7c03b5e8-90f6-4155-8f42-bc665f7f0e8c'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ee6884-6a61-45d5-85bf-e3f9db307e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:12 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Volume volume-5454af8a-9141-4329-b16f-0d7edcd76db8 (5454af8a-9141-4329-b16f-0d7edcd76db8): created successfully Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ee6884-6a61-45d5-85bf-e3f9db307e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Flow 'volume_create_manager' (5d1c0c79-f984-41a1-adcd-c6c12f7f7e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:12 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a4369c54-837e-4eb7-bd09-190c2dfa9648 tempest-VolumesDeleteCascade-1088091563 None] Created volume successfully. Apr 30 11:09:12 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-c12008f9-47c2-4f9d-bbe0-eea37600e145-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520" returned: 0 in 0.848s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:12 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520 Apr 30 11:09:12 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Flow 'volume_create_manager' (e8f2f1fe-e4f4-494f-971a-3916626c793f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f068e-1fd7-4176-8e0d-51c0dc294f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-c12008f9-47c2-4f9d-bbe0-eea37600e145-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7f068e-1fd7-4176-8e0d-51c0dc294f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977379522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048d51a6-cf49-44cb-b3cc-789b1431df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e622005cd8747fd87047c5b1981d9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:13Z,use_quota=True,user_id='2a73d8f512634bcfb9df1fdd332615ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10aa712-c343-41fd-b465-6e61b9fc4965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b10aa712-c343-41fd-b465-6e61b9fc4965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3066a5c2-b53c-4c27-a85c-a1586f5cc67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3066a5c2-b53c-4c27-a85c-a1586f5cc67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '048d51a6-cf49-44cb-b3cc-789b1431df8e', 'volume_name': 'volume-048d51a6-cf49-44cb-b3cc-789b1431df8e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb8e00f-0ac8-4a6f-ba46-02226bd38324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeb8e00f-0ac8-4a6f-ba46-02226bd38324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87616be-bd27-4519-b1af-9393a35274d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:13 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Volume 048d51a6-cf49-44cb-b3cc-789b1431df8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-048d51a6-cf49-44cb-b3cc-789b1431df8e', 'volume_size': 1} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Performing cascade delete. {{(pid=84206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Deleting offline snapshot 7c03b5e8-90f6-4155-8f42-bc665f7f0e8c of volume c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] snapshot_file for this snap is: volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad624fc7-cc00-4785-8a9f-91178a90d780]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:13 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee 1073741824" returned: 0 in 1.023s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:13 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:09:13 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:13 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee Apr 30 11:09:13 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:13 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-63ac6f56-4252-42a1-a26e-1bd60a19b520" returned: 0 in 0.696s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-quobyte-63ac6f56-4252-42a1-a26e-1bd60a19b520" released by "delete_volume" :: held 1.604s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.quota [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Created reservations ['27f9bc7e-a3ec-4516-98e9-5a83e3c56f8e', 'bf4fed38-7726-4570-b9af-0084170c458f', '58e7c860-1b55-495f-af28-7a61be2f7859', '3fae88f4-4be2-4818-a215-7ddfe0baeff9'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:13 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:13 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:13 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.739s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c12008f9-47c2-4f9d-bbe0-eea37600e145(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe67dd6-bc0b-408b-9811-d5b71c93edfa]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:13 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee" returned: 0 in 0.700s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1977379522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=048d51a6-cf49-44cb-b3cc-789b1431df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e622005cd8747fd87047c5b1981d9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:13Z,use_quota=True,user_id='2a73d8f512634bcfb9df1fdd332615ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Creating volume 048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:14 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52aa0eb6-b832-4e95-9a19-b77c0648be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48c5e64-cead-4b5e-ada9-05855256b5ee', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89507ae6-0fcc-4a85-9e8a-605629a2f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:14 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e 1073741824 Apr 30 11:09:14 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:14 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Volume volume-f48c5e64-cead-4b5e-ada9-05855256b5ee (f48c5e64-cead-4b5e-ada9-05855256b5ee): created successfully Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89507ae6-0fcc-4a85-9e8a-605629a2f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Flow 'volume_create_manager' (9dc32568-0e08-49f9-9e67-8a5088f3dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:14 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:09:14 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-023ec431-1e83-4af6-8d1a-ec3ebd39a1c6 tempest-GroupSnapshotsV319Test-762217778 None] Created volume successfully. Apr 30 11:09:14 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.709s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.manager [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Deleted volume successfully. Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [req-2bfa2271-b5e5-4148-a787-0311c459432e req-1c344394-4b8a-4508-9f2a-662db78aa4a8 tempest-ServerBootFromVolumeStableRescueTest-45896497 None] Lock "cinder-63ac6f56-4252-42a1-a26e-1bd60a19b520-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] GroupSnapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: creating. Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Group snapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: creating. {{(pid=84206) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:14 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 0.870s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:14 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:09:14 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:15 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e 1073741824" returned: 0 in 0.978s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:15 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:15 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:15 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.731s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:15 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c Apr 30 11:09:15 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:15 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 0.726s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.162s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87616be-bd27-4519-b1af-9393a35274d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-048d51a6-cf49-44cb-b3cc-789b1431df8e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934e0efb-a0e5-45a1-aba8-44c529b48854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Creating offline snapshot b64e259e-d964-4418-99e1-0e843d1bd529 of volume f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ef8279-3b41-44d3-af26-ca5037aac2d9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:15 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Volume volume-048d51a6-cf49-44cb-b3cc-789b1431df8e (048d51a6-cf49-44cb-b3cc-789b1431df8e): created successfully Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934e0efb-a0e5-45a1-aba8-44c529b48854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Flow 'volume_create_manager' (e8f2f1fe-e4f4-494f-971a-3916626c793f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e0739420-72ab-4cfa-a2f5-a8f66fbd6030 tempest-VolumesCloneTest-1638305362 None] Created volume successfully. Apr 30 11:09:16 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee Apr 30 11:09:16 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:16 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145.7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" returned: 0 in 0.659s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c" released by "_delete_snapshot" :: held 3.128s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" released by "delete_snapshot" :: held 3.157s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['7878cdfa-4861-433c-a550-425dfa1a29d4', '2d6bcf7c-bd00-4b5f-998a-3f619bfa13e6', '22c897e8-caf1-4220-9bb4-cf218dbf0a81', '5f61d7f9-04a9-406f-bbf3-4138babdca39'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:16 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Delete snapshot completed successfully. Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-7c03b5e8-90f6-4155-8f42-bc665f7f0e8c-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Snapshots deleted, issuing volume delete {{(pid=84206) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce3e8a2-310a-445c-bfcd-53bcc9f077e4]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:16 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:09:16 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Flow 'volume_create_manager' (a6cc863b-ccdc-4c1a-85e6-daf0a04781b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639c5c33-1d28-45ca-a5c1-36f2e46ebd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:16 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee" returned: 0 in 0.979s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639c5c33-1d28-45ca-a5c1-36f2e46ebd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-493771480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bf7e54-9827-4dac-b3fc-65020962a0e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e622005cd8747fd87047c5b1981d9de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=048d51a6-cf49-44cb-b3cc-789b1431df8e,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:17Z,use_quota=True,user_id='2a73d8f512634bcfb9df1fdd332615ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37df50-ef4e-4f93-960f-9ed5f41116d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b37df50-ef4e-4f93-960f-9ed5f41116d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:16 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 1G Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d161ad-7500-42d6-a48e-26169c994ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:16 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1d161ad-7500-42d6-a48e-26169c994ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c0bf7e54-9827-4dac-b3fc-65020962a0e6', 'volume_name': 'volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6', 'volume_size': 2, 'source_volid': '048d51a6-cf49-44cb-b3cc-789b1431df8e', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad735322-2001-4514-9b51-2849376361a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad735322-2001-4514-9b51-2849376361a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:17 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b95d3-4278-400d-bda3-88b8d73b6e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:17 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Volume c0bf7e54-9827-4dac-b3fc-65020962a0e6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6', 'volume_size': 2, 'source_volid': '048d51a6-cf49-44cb-b3cc-789b1431df8e', 'source_volstatus': 'available'} Apr 30 11:09:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:17 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 1.137s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:17 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145 Apr 30 11:09:17 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:18 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 1G" returned: 0 in 1.247s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f48c5e64-cead-4b5e-ada9-05855256b5ee -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:18 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f48c5e64-cead-4b5e-ada9-05855256b5ee -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 Apr 30 11:09:18 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:18 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c12008f9-47c2-4f9d-bbe0-eea37600e145" returned: 0 in 0.763s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-c12008f9-47c2-4f9d-bbe0-eea37600e145" released by "delete_volume" :: held 1.995s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['e6083768-deff-4db7-8845-41b86071ef0e', 'ba7f8629-67aa-4018-9943-ee7691da88c6', '4a0ab236-f387-4fe7-bea2-6750ec8ba172', 'b11936ac-2b9e-40dd-a95e-d751ba256be3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:18 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:18 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:18 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f48c5e64-cead-4b5e-ada9-05855256b5ee -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529" returned: 0 in 0.864s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:18 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:09:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:18 devstack sudo[89114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 Apr 30 11:09:18 devstack sudo[89114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:19 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.694s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:19 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Deleted volume successfully. Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e7ae3db-ae13-4eb6-945c-0df54f5ea44a tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-c12008f9-47c2-4f9d-bbe0-eea37600e145-delete_volume" released by "delete_volume" :: held 6.502s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-5454af8a-9141-4329-b16f-0d7edcd76db8-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-5454af8a-9141-4329-b16f-0d7edcd76db8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:19 devstack sudo[89114]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529" returned: 0 in 0.820s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f112e6-963c-4656-a2a3-f7424a2469f7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:19 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info Apr 30 11:09:19 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:19 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 Apr 30 11:09:19 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:20 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info" returned: 0 in 0.645s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:20 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:09:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:20 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info Apr 30 11:09:20 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:20 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8" returned: 0 in 0.839s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:20 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8 Apr 30 11:09:20 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:21 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.info" returned: 0 in 0.711s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.405s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.133s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:21 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Cloning volume 048d51a6-cf49-44cb-b3cc-789b1431df8e to volume c0bf7e54-9827-4dac-b3fc-65020962a0e6 Apr 30 11:09:21 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5454af8a-9141-4329-b16f-0d7edcd76db8" returned: 0 in 0.608s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Creating offline snapshot f899ac6f-f90b-4a29-a7cd-6152f5508851 of volume 048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-quobyte-5454af8a-9141-4329-b16f-0d7edcd76db8" released by "delete_volume" :: held 1.513s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c638166-c7b4-4913-99a0-12fb73c3b65c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Created reservations ['d0795e40-7a02-4a51-939e-53e9ae8b8650', 'b228d5cd-baab-4335-a76b-f54bb676ee53', 'e80d7ddd-f042-424e-ab68-e4acfdef5d48', 'b20c941d-e28e-4aaf-acf1-317d679dcee6'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:21 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bac60a30-ce01-4018-b890-2cdbd28b349d tempest-GroupSnapshotsV319Test-762217778 None] group_snapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: created successfully Apr 30 11:09:21 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:21 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:21 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:21 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:22 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 0.819s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:22 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 1G Apr 30 11:09:22 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:22 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Deleted volume successfully. Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-24eae089-a1c1-4518-9ce6-68bddec0c132 tempest-VolumesDeleteCascade-1088091563 None] Lock "cinder-5454af8a-9141-4329-b16f-0d7edcd76db8-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] group_snapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: deleting Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] group_snapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: deleting {{(pid=84206) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "cinder-quobyte-b64e259e-d964-4418-99e1-0e843d1bd529" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-b64e259e-d964-4418-99e1-0e843d1bd529" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Deleting offline snapshot b64e259e-d964-4418-99e1-0e843d1bd529 of volume f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] snapshot_file for this snap is: volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74494e0-7081-469f-90e4-7d454175180b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:22 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 Apr 30 11:09:22 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:23 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 1G" returned: 0 in 1.084s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048d51a6-cf49-44cb-b3cc-789b1431df8e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:23 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048d51a6-cf49-44cb-b3cc-789b1431df8e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:23 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:23 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529" returned: 0 in 0.876s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f48c5e64-cead-4b5e-ada9-05855256b5ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a58a83-ac41-43d9-b880-ce6a0d2f90ef]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:23 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee Apr 30 11:09:23 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:24 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-048d51a6-cf49-44cb-b3cc-789b1431df8e -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 0.875s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:24 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 is being set with open permissions: ugo+rw Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:24 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:24 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:24 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee" returned: 0 in 1.005s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:24 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 0.711s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:24 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 Apr 30 11:09:24 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:24 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info Apr 30 11:09:24 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:25 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info" returned: 0 in 0.840s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:25 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info is being set with open permissions: ugo+rw Apr 30 11:09:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:25 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529" returned: 0 in 0.937s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:25 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info Apr 30 11:09:25 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:25 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529 Apr 30 11:09:25 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:26 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee.b64e259e-d964-4418-99e1-0e843d1bd529" returned: 0 in 0.664s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-b64e259e-d964-4418-99e1-0e843d1bd529" released by "_delete_snapshot" :: held 3.710s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" released by "delete_snapshot" :: held 3.762s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:26 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-991758665 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-991758665, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:09:26 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-991758665 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-991758665, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:09:26 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.info" returned: 0 in 0.905s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] Created reservations ['fd460be3-4329-466a-9042-bfe8941f92e7', '1d6a09f2-4b10-4b21-9387-eea1b7172d30', 'e1398f01-0427-47cf-88be-54571fa314ba', '9aae6beb-ecb8-46eb-affc-d456cdc0a06b'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] snapshot: f899ac6f-f90b-4a29-a7cd-6152f5508851, volume: c0bf7e54-9827-4dac-b3fc-65020962a0e6, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9ffc6-54c1-441d-b47b-8e4480a491cb]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f49d537a-e9f3-4c29-903f-8c8f28d9a759 tempest-GroupSnapshotsV319Test-762217778 None] group_snapshot 32744a81-c2cc-4545-939a-5d35d6fb82e8: deleted successfully Apr 30 11:09:26 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:26 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ddd6d9-5147-4a92-8ab4-6b41014c0081]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Flow 'volume_create_manager' (edc65a70-36a5-499e-a3d9-a9e3c9095436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e4d5c-13ed-451a-8938-fdb80c203202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:27 devstack sudo[89190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee Apr 30 11:09:27 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461e4d5c-13ed-451a-8938-fdb80c203202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-980925966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580149bf-b74a-4df3-9eb8-80c41565bd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03762891cb2b4423bb488ad6d855aaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:28Z,use_quota=True,user_id='e56ee24506ee4dafbfa3291689dd62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feebf19-8e9d-4ba7-9b46-b4a273e595da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4feebf19-8e9d-4ba7-9b46-b4a273e595da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:27 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d9575c-44ba-4edf-82de-05eace743649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d9575c-44ba-4edf-82de-05eace743649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '580149bf-b74a-4df3-9eb8-80c41565bd8a', 'volume_name': 'volume-580149bf-b74a-4df3-9eb8-80c41565bd8a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6ad4d3-bf35-408e-9866-c5e2ce7f321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6ad4d3-bf35-408e-9866-c5e2ce7f321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a048cbe2-05d7-4120-9146-589132ad6d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Volume 580149bf-b74a-4df3-9eb8-80c41565bd8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-580149bf-b74a-4df3-9eb8-80c41565bd8a', 'volume_size': 1} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 1.122s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048d51a6-cf49-44cb-b3cc-789b1431df8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b787f95-3db5-4c7a-af94-a553183ecdfa]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:27 devstack sudo[89192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:27 devstack sudo[89192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:28 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee" returned: 0 in 0.886s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:28 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee Apr 30 11:09:28 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:28 devstack sudo[89192]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 0.978s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:28 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:09:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:28 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 Apr 30 11:09:28 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:29 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f48c5e64-cead-4b5e-ada9-05855256b5ee" returned: 0 in 0.893s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Lock "cinder-quobyte-f48c5e64-cead-4b5e-ada9-05855256b5ee" released by "delete_volume" :: held 1.878s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Created reservations ['c6fa1000-579f-4e31-ac4d-3825964a52c5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:29 devstack cinder-volume[84206]: WARNING cinder.quota [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-991758665 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-991758665, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Created reservations ['16b269fa-ffa9-47fa-bf7e-c62e6a074632', 'f1c3ab68-de60-49d9-b22b-fa116a1b0bbb', 'b62524cd-2efb-45d0-8de9-290f53d2c078', '8f32024d-c223-4124-be2a-a386d9e98c4d'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:29 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:29 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:31 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.687s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:31 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0b0822a1-10c6-4e12-b179-5930059b6984 tempest-GroupSnapshotsV319Test-762217778 None] Delete group completed successfully. Apr 30 11:09:35 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6" returned: 0 in 6.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccd99c1-06c0-4262-a2b4-6983d5064acb]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:35 devstack sudo[89221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:35 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:36 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 1.035s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:36 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:09:36 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Converted 1024.00 MB image at 149.21 MB/s Apr 30 11:09:36 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 is being set with open permissions: ugo+rw Apr 30 11:09:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:36 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 Apr 30 11:09:36 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:37 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6" returned: 0 in 0.675s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" released by "_copy_volume_from_snapshot" :: held 10.805s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-quobyte-f899ac6f-f90b-4a29-a7cd-6152f5508851" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-f899ac6f-f90b-4a29-a7cd-6152f5508851" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Deleting offline snapshot f899ac6f-f90b-4a29-a7cd-6152f5508851 of volume 048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] snapshot_file for this snap is: volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d0b224-26e8-4d89-8226-3fd3f71ebb84]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:37 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:37 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:38 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 0.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-048d51a6-cf49-44cb-b3cc-789b1431df8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:09:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[580774ba-a77c-4577-b68f-9be9d80f32a3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:38 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:38 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:39 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 0.949s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:39 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:39 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:40 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 0.828s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:40 devstack sudo[89251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851 Apr 30 11:09:40 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:41 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e.f899ac6f-f90b-4a29-a7cd-6152f5508851" returned: 0 in 0.812s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-f899ac6f-f90b-4a29-a7cd-6152f5508851" released by "_delete_snapshot" :: held 3.570s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.923s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.331s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-980925966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=580149bf-b74a-4df3-9eb8-80c41565bd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03762891cb2b4423bb488ad6d855aaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:28Z,use_quota=True,user_id='e56ee24506ee4dafbfa3291689dd62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Creating volume 580149bf-b74a-4df3-9eb8-80c41565bd8a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:41 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:41 devstack sudo[89254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a 1073741824 Apr 30 11:09:41 devstack sudo[89254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (158b95d3-4278-400d-bda3-88b8d73b6e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6', 'volume_size': 2, 'source_volid': '048d51a6-cf49-44cb-b3cc-789b1431df8e', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e21a0-d886-432c-bcfb-78e9cc03f2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:41 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Volume volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 (c0bf7e54-9827-4dac-b3fc-65020962a0e6): created successfully Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a10e21a0-d886-432c-bcfb-78e9cc03f2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Flow 'volume_create_manager' (a6cc863b-ccdc-4c1a-85e6-daf0a04781b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:41 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-5884b264-4983-405d-a213-c390d03c8dcd tempest-VolumesCloneTest-1638305362 None] Created volume successfully. Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-c0bf7e54-9827-4dac-b3fc-65020962a0e6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "cinder-c0bf7e54-9827-4dac-b3fc-65020962a0e6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9533e29-c11a-496e-a9c1-c3ea63653002]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:41 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 Apr 30 11:09:41 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:42 devstack sudo[89254]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a 1073741824" returned: 0 in 1.334s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:42 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a Apr 30 11:09:42 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:43 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6" returned: 0 in 1.166s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:43 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6 Apr 30 11:09:43 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:43 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a" returned: 0 in 0.990s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] <== create_volume: return (2412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.418s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a048cbe2-05d7-4120-9146-589132ad6d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-580149bf-b74a-4df3-9eb8-80c41565bd8a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02ff435-f458-4edd-a4f9-412a29b65056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:43 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Volume volume-580149bf-b74a-4df3-9eb8-80c41565bd8a (580149bf-b74a-4df3-9eb8-80c41565bd8a): created successfully Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02ff435-f458-4edd-a4f9-412a29b65056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Flow 'volume_create_manager' (edc65a70-36a5-499e-a3d9-a9e3c9095436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1331a7eb-d751-420c-9d87-1f3e9b929814 tempest-VolumesTransfersV355Test-787777031 None] Created volume successfully. Apr 30 11:09:43 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c0bf7e54-9827-4dac-b3fc-65020962a0e6" returned: 0 in 0.829s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-c0bf7e54-9827-4dac-b3fc-65020962a0e6" released by "delete_volume" :: held 2.053s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:43 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Created reservations ['8b46ecd1-aead-4a7e-a141-2a4f27b049dd', '9c75f752-5893-44f5-a2fc-d06282fa1d34', 'ba6c1f6e-7162-4fb1-8d98-bfcbc25f6da6', '657c1ff0-ee55-46fe-b007-a62400419904'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:44 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:44 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:44 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.706s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:44 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Deleted volume successfully. Apr 30 11:09:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9ab59122-b758-4f13-8671-50a9d708495a tempest-VolumesCloneTest-1638305362 None] Lock "cinder-c0bf7e54-9827-4dac-b3fc-65020962a0e6-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-048d51a6-cf49-44cb-b3cc-789b1431df8e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "cinder-048d51a6-cf49-44cb-b3cc-789b1431df8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Acquiring lock "cinder-quobyte-048d51a6-cf49-44cb-b3cc-789b1431df8e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-048d51a6-cf49-44cb-b3cc-789b1431df8e" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f766fb-f160-48f9-a5bf-087df1236a10]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-92c56962-ec8c-4eac-b935-1d7442d2684c tempest-VolumesTransfersV355Test-1970747964 None] Transfer volume completed successfully. Apr 30 11:09:45 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:45 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-38bb1d8c-0986-441b-ac85-7c9e0624cee7 tempest-GroupsV314Test-1698171399 None] Group tempest-GroupsV314Test-Group-1344701534: creating Apr 30 11:09:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-38bb1d8c-0986-441b-ac85-7c9e0624cee7 tempest-GroupsV314Test-1698171399 None] Group tempest-GroupsV314Test-Group-1344701534: created successfully Apr 30 11:09:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-38bb1d8c-0986-441b-ac85-7c9e0624cee7 tempest-GroupsV314Test-1698171399 None] Create group completed successfully. Apr 30 11:09:46 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 1.003s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:46 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e Apr 30 11:09:46 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "cinder-580149bf-b74a-4df3-9eb8-80c41565bd8a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-580149bf-b74a-4df3-9eb8-80c41565bd8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "cinder-quobyte-580149bf-b74a-4df3-9eb8-80c41565bd8a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-quobyte-580149bf-b74a-4df3-9eb8-80c41565bd8a" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[463e8f8b-e20d-4971-8213-c5834fe97d3e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:47 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a Apr 30 11:09:47 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:47 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-048d51a6-cf49-44cb-b3cc-789b1431df8e" returned: 0 in 0.747s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "cinder-quobyte-048d51a6-cf49-44cb-b3cc-789b1431df8e" released by "delete_volume" :: held 1.862s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Created reservations ['97463e33-e002-40f7-a020-ab048e8bacab', '0b4cb1a1-1370-4542-ba81-eb1a030c4f28', 'ef58b0c7-d378-4423-bb7f-15d3232a07ae', '7d59b9f8-6cd3-455b-af00-f8a75d0a79d8'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:47 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:47 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:47 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a" returned: 0 in 0.846s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:47 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a Apr 30 11:09:47 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Flow 'volume_create_manager' (c812a166-1d29-46a6-bef3-ae55064c3993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a8f47a-c982-4853-90cc-9cccdf185100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a8f47a-c982-4853-90cc-9cccdf185100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1261049997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=362d6930-31b5-46a1-8320-c29eefd38cd7,host='devstack@QuobyteHD#QuobyteHD',id=27bba761-a9ad-4447-abc2-3dd54372c6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e624b53ffab423e88f57cda6477f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:48Z,use_quota=True,user_id='2a0c8935c6e14670b69c997643b1ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b56ba6e1-f9e8-4a5c-bacc-601ea4dfc482),volume_type_id=b56ba6e1-f9e8-4a5c-bacc-601ea4dfc482)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ecf88-1c64-461d-89c3-04eecfac4639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ecf88-1c64-461d-89c3-04eecfac4639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8b8179-f3e7-4d1b-826b-88bf1cc5663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c8b8179-f3e7-4d1b-826b-88bf1cc5663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27bba761-a9ad-4447-abc2-3dd54372c6db', 'volume_name': 'volume-27bba761-a9ad-4447-abc2-3dd54372c6db', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6029a9-5935-45d5-9f03-003117b7a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6029a9-5935-45d5-9f03-003117b7a20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f826a310-3293-4528-bc25-2b67faab23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Volume 27bba761-a9ad-4447-abc2-3dd54372c6db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27bba761-a9ad-4447-abc2-3dd54372c6db', 'volume_size': 1} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=362d6930-31b5-46a1-8320-c29eefd38cd7,created_at=2026-04-30T09:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1261049997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=362d6930-31b5-46a1-8320-c29eefd38cd7,host='devstack@QuobyteHD#QuobyteHD',id=27bba761-a9ad-4447-abc2-3dd54372c6db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e624b53ffab423e88f57cda6477f3ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:48Z,use_quota=True,user_id='2a0c8935c6e14670b69c997643b1ac98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b56ba6e1-f9e8-4a5c-bacc-601ea4dfc482),volume_type_id=b56ba6e1-f9e8-4a5c-bacc-601ea4dfc482)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Creating volume 27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:48 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:48 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db 1073741824 Apr 30 11:09:48 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:48 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.973s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Deleted volume successfully. Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81221043-b419-45d0-b2bb-0f243114e215 tempest-VolumesCloneTest-1638305362 None] Lock "cinder-048d51a6-cf49-44cb-b3cc-789b1431df8e-delete_volume" released by "delete_volume" :: held 3.115s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:48 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-580149bf-b74a-4df3-9eb8-80c41565bd8a" returned: 0 in 0.912s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-quobyte-580149bf-b74a-4df3-9eb8-80c41565bd8a" released by "delete_volume" :: held 1.817s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Created reservations ['d2e1a655-e095-4cc0-b6bb-655797602a27', '4f801388-dcb2-4dc0-8fb6-d35b8c6d5779', 'a48afe2b-8eef-4366-83ea-31f175eb6736', 'c0399fdf-25a0-48fc-89fd-46cd928c3dd7'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:48 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:49 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:49 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db 1073741824" returned: 0 in 1.259s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:49 devstack sudo[89338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:09:49 devstack sudo[89338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:49 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.911s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:49 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Deleted volume successfully. Apr 30 11:09:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdf5d223-5c5d-4d66-95ec-5597c65d3cdb tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-580149bf-b74a-4df3-9eb8-80c41565bd8a-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Flow 'volume_create_manager' (c09fc661-c126-4b1d-a2d7-2ef0456bb8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f704a598-cfa0-460e-851d-847fe3f24cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f704a598-cfa0-460e-851d-847fe3f24cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1951273154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b52651d-3499-4b7d-bffa-c5fc28092179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03762891cb2b4423bb488ad6d855aaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:50Z,use_quota=True,user_id='e56ee24506ee4dafbfa3291689dd62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9750785-baef-4fb6-b19d-ccdb6392113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9750785-baef-4fb6-b19d-ccdb6392113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7fdd02-4a2c-479c-8529-016d86f20768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7fdd02-4a2c-479c-8529-016d86f20768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b52651d-3499-4b7d-bffa-c5fc28092179', 'volume_name': 'volume-3b52651d-3499-4b7d-bffa-c5fc28092179', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27aa0fea-3696-48fa-b213-a860f145318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27aa0fea-3696-48fa-b213-a860f145318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c314a1-4b27-41c2-98a1-3876b519d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Volume 3b52651d-3499-4b7d-bffa-c5fc28092179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b52651d-3499-4b7d-bffa-c5fc28092179', 'volume_size': 1} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:50 devstack sudo[89338]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 0.828s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.266s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1951273154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b52651d-3499-4b7d-bffa-c5fc28092179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03762891cb2b4423bb488ad6d855aaaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:50Z,use_quota=True,user_id='e56ee24506ee4dafbfa3291689dd62b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Creating volume 3b52651d-3499-4b7d-bffa-c5fc28092179 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:50 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f826a310-3293-4528-bc25-2b67faab23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27bba761-a9ad-4447-abc2-3dd54372c6db', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaa9a19-6468-485e-ac4a-f63c7653ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:50 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 1073741824 Apr 30 11:09:50 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Volume volume-27bba761-a9ad-4447-abc2-3dd54372c6db (27bba761-a9ad-4447-abc2-3dd54372c6db): created successfully Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efaa9a19-6468-485e-ac4a-f63c7653ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Flow 'volume_create_manager' (c812a166-1d29-46a6-bef3-ae55064c3993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e07ee4c5-e510-42f3-9774-aa64ce014657 tempest-GroupsV314Test-1698171399 None] Created volume successfully. Apr 30 11:09:51 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 1073741824" returned: 0 in 0.974s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:51 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 Apr 30 11:09:51 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:52 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179" returned: 0 in 0.841s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c314a1-4b27-41c2-98a1-3876b519d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b52651d-3499-4b7d-bffa-c5fc28092179', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dee0ca-cde8-46c2-9cce-d6f09e8adfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Volume volume-3b52651d-3499-4b7d-bffa-c5fc28092179 (3b52651d-3499-4b7d-bffa-c5fc28092179): created successfully Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dee0ca-cde8-46c2-9cce-d6f09e8adfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Flow 'volume_create_manager' (c09fc661-c126-4b1d-a2d7-2ef0456bb8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (cc600927-afa8-47e4-9c5d-d283a5693fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0927861-4e58-4fb1-96da-b0d8775b8114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-01264c83-735d-4e78-9d42-5514c6b6801e tempest-VolumesTransfersV355Test-787777031 None] Created volume successfully. Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0927861-4e58-4fb1-96da-b0d8775b8114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1191237407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f66be3-fd3b-4446-a76e-f8c0d0348961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:52Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f44a67c-b62f-486b-a4e5-a80725d7bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f44a67c-b62f-486b-a4e5-a80725d7bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80b4045-3948-44e5-972f-270bfd83325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80b4045-3948-44e5-972f-270bfd83325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f66be3-fd3b-4446-a76e-f8c0d0348961', 'volume_name': 'volume-98f66be3-fd3b-4446-a76e-f8c0d0348961', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081971fb-376f-4ecd-9271-486ef3bbb471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081971fb-376f-4ecd-9271-486ef3bbb471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772d9f3b-1bcf-40cc-b271-46a54e796aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Volume 98f66be3-fd3b-4446-a76e-f8c0d0348961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f66be3-fd3b-4446-a76e-f8c0d0348961', 'volume_size': 1} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1191237407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f66be3-fd3b-4446-a76e-f8c0d0348961,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:52Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Creating volume 98f66be3-fd3b-4446-a76e-f8c0d0348961 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:09:52 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:52 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 1073741824 Apr 30 11:09:52 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:53 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 1073741824" returned: 0 in 0.891s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:53 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 Apr 30 11:09:53 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "cinder-3b52651d-3499-4b7d-bffa-c5fc28092179-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-3b52651d-3499-4b7d-bffa-c5fc28092179-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "cinder-quobyte-3b52651d-3499-4b7d-bffa-c5fc28092179" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-quobyte-3b52651d-3499-4b7d-bffa-c5fc28092179" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3982ae-0956-4255-a9ac-5baf7a306b58]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:53 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 Apr 30 11:09:53 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:54 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961" returned: 0 in 0.703s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.383s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:54 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Cloning volume 27bba761-a9ad-4447-abc2-3dd54372c6db to volume 037da8eb-58c6-4d26-9872-c2e4badad18e Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772d9f3b-1bcf-40cc-b271-46a54e796aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f66be3-fd3b-4446-a76e-f8c0d0348961', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b6877e-0357-4d21-9651-06031446701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:54 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Volume volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 (98f66be3-fd3b-4446-a76e-f8c0d0348961): created successfully Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b6877e-0357-4d21-9651-06031446701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (cc600927-afa8-47e4-9c5d-d283a5693fab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Creating offline snapshot 06a85db7-91d2-4c83-abdc-d22b0e33fcce of volume 27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:09:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ebdac302-e6e3-4331-8718-a794f4c8b787 tempest-VolumesListTestJSON-1606200651 None] Created volume successfully. Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6793d1e-895a-404f-aac5-0c7476662de1]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:54 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:09:54 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:54 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179" returned: 0 in 0.782s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:54 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179 Apr 30 11:09:54 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (4331e69f-3502-440f-9b89-71078bd8ace2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408baa4a-fc8f-434c-8ac5-9ac78407ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:55 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408baa4a-fc8f-434c-8ac5-9ac78407ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2124332961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:55Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:55 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce 1G Apr 30 11:09:55 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d25038c-04ae-4757-b5a3-694dccafa297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d25038c-04ae-4757-b5a3-694dccafa297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6de2338-6226-425b-8398-aae5c81ad723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6de2338-6226-425b-8398-aae5c81ad723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5', 'volume_name': 'volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84bfce-38c6-429a-8b66-7ef631c85ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f84bfce-38c6-429a-8b66-7ef631c85ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1a0607-6f5a-4f45-b4ae-87f422634676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:09:55 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Volume 0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5', 'volume_size': 1} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:55 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3b52651d-3499-4b7d-bffa-c5fc28092179" returned: 0 in 0.794s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-quobyte-3b52651d-3499-4b7d-bffa-c5fc28092179" released by "delete_volume" :: held 1.619s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Created reservations ['cc455704-8dc1-4028-88fb-9d967c6b2e01', '0506be64-7c01-4c74-ad09-5f141d3786e1', '6e7db78e-d179-4993-8cf1-04e4389133d2', '55a15639-a258-46b5-bc2c-13bd29d4fbeb'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:55 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:09:55 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:56 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce 1G" returned: 0 in 0.940s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bba761-a9ad-4447-abc2-3dd54372c6db -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:56 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bba761-a9ad-4447-abc2-3dd54372c6db -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:09:56 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:56 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.774s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:09:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Deleted volume successfully. Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d7fc4643-83d7-4e43-9ba4-b03611325b94 tempest-VolumesTransfersV355Test-101746981 None] Lock "cinder-3b52651d-3499-4b7d-bffa-c5fc28092179-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:09:56 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27bba761-a9ad-4447-abc2-3dd54372c6db -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.741s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:56 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:09:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:56 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:09:56 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:57 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.905s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:57 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info Apr 30 11:09:57 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:58 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info" returned: 0 in 0.954s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:58 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:09:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:58 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info Apr 30 11:09:58 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:09:59 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.info" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Acquiring lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] snapshot: 06a85db7-91d2-4c83-abdc-d22b0e33fcce, volume: 037da8eb-58c6-4d26-9872-c2e4badad18e, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5882e49-608f-46c2-a8f7-81175b64bbe7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:09:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:09:59 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:09:59 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:00 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.992s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27bba761-a9ad-4447-abc2-3dd54372c6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc4506-98f4-4725-a209-d2169ea78c04]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:00 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:10:00 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:01 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 1.037s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:01 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:10:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:01 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e Apr 30 11:10:01 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:07 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:07 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:07 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=94,cinder:INSERT=31,cinder:UPDATE=118,cinder:DELETE=6 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:10:07 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=98,cinder:INSERT=26,cinder:UPDATE=113,cinder:DELETE=10 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:10:08 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.302s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:09 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e" returned: 0 in 7.939s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:09 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[078fb553-a014-4703-b658-c634bd314923]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:09 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:10:09 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:11 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 1.637s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db, size 1024.00 MB, duration 7.94 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:10:11 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Converted 1024.00 MB image at 128.95 MB/s Apr 30 11:10:11 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e is being set with open permissions: ugo+rw: NotImplementedError Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:11 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e Apr 30 11:10:11 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Flow 'volume_create_manager' (bd31f24f-1cab-4d66-bfac-ace491cf7c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c49607-5d33-4238-b31f-fd99f9a58f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c49607-5d33-4238-b31f-fd99f9a58f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-275104151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7402c4-eae5-48ec-bcd7-7cd684284896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46661579b4154e21895b987fbfca6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:12Z,use_quota=True,user_id='df1c3da1b66645d2ae93cf9306cfbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528056d-a42d-4aad-9512-a304760a8dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9528056d-a42d-4aad-9512-a304760a8dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae88eeb6-579e-4dd9-8884-ef9f403884e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae88eeb6-579e-4dd9-8884-ef9f403884e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7402c4-eae5-48ec-bcd7-7cd684284896', 'volume_name': 'volume-8c7402c4-eae5-48ec-bcd7-7cd684284896', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f113b2-707b-464b-a541-c309884b79de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f113b2-707b-464b-a541-c309884b79de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d490dd-4c1b-4be8-97c5-a4cc0f0aa717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Volume 8c7402c4-eae5-48ec-bcd7-7cd684284896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7402c4-eae5-48ec-bcd7-7cd684284896', 'volume_size': 1} Apr 30 11:10:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:12 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e" returned: 0 in 0.871s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" released by "_copy_volume_from_snapshot" :: held 12.620s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Acquiring lock "cinder-quobyte-06a85db7-91d2-4c83-abdc-d22b0e33fcce" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-06a85db7-91d2-4c83-abdc-d22b0e33fcce" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Deleting offline snapshot 06a85db7-91d2-4c83-abdc-d22b0e33fcce of volume 27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] snapshot_file for this snap is: volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c9e60-5bd0-4041-97c7-b05d55ed1aa6]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:12 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:10:12 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:13 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.774s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27bba761-a9ad-4447-abc2-3dd54372c6db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:10:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[314cf604-471b-4197-8201-ce6eb3132af5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:13 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:10:13 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:14 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 0.929s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:14 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:10:14 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:14 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:14 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce Apr 30 11:10:14 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:15 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db.06a85db7-91d2-4c83-abdc-d22b0e33fcce" returned: 0 in 0.798s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-06a85db7-91d2-4c83-abdc-d22b0e33fcce" released by "_delete_snapshot" :: held 3.446s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.619s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.532s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2124332961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:09:55Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Creating volume 0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:15 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:15 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 1073741824 Apr 30 11:10:15 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ff1511c8-f291-4147-8032-86ef4ba74b59 tempest-GroupsV314Test-1698171399 None] Create group from source-group-362d6930-31b5-46a1-8320-c29eefd38cd7 completed successfully. Apr 30 11:10:17 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 1073741824" returned: 0 in 1.198s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:17 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 Apr 30 11:10:17 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Acquiring lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ce2b7-2fe6-4065-b864-4a93e2849d78]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:17 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e Apr 30 11:10:17 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:17 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" returned: 0 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.151s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.264s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-275104151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c7402c4-eae5-48ec-bcd7-7cd684284896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46661579b4154e21895b987fbfca6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:12Z,use_quota=True,user_id='df1c3da1b66645d2ae93cf9306cfbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Creating volume 8c7402c4-eae5-48ec-bcd7-7cd684284896 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:18 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:18 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 1073741824 Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1a0607-6f5a-4f45-b4ae-87f422634676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:18 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e27a226-0fc9-4002-b7fb-9e83e0064504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:18 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Volume volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 (0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5): created successfully Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e27a226-0fc9-4002-b7fb-9e83e0064504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (4331e69f-3502-440f-9b89-71078bd8ace2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:18 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-88941887-1327-4e30-a091-0b58cb17d98d tempest-VolumesListTestJSON-1606200651 None] Created volume successfully. Apr 30 11:10:18 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e" returned: 0 in 1.231s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:18 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e Apr 30 11:10:18 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:19 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 1073741824" returned: 0 in 1.385s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:19 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-037da8eb-58c6-4d26-9872-c2e4badad18e" returned: 0 in 0.916s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-037da8eb-58c6-4d26-9872-c2e4badad18e" released by "delete_volume" :: held 2.217s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:19 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 Apr 30 11:10:19 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Created reservations ['8ae46d3d-2927-4e6b-8308-152a4d5e8ef5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:19 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-682634858 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-682634858, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:10:19 devstack cinder-volume[84206]: WARNING cinder.quota [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-682634858 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-682634858, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Created reservations ['8c64475d-86c0-4717-98ce-b924482b323a', 'a2219b79-357c-4880-ace7-15048770f422', 'cd317909-0d6c-4bce-b518-a3620e7fcd6d', '86741dd6-4e62-46aa-8745-bd4de4b183e1'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:19 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:19 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (40960cf6-1830-42d5-971c-2d31050fe14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940e68a7-249e-4ef3-af8b-92649b63d5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940e68a7-249e-4ef3-af8b-92649b63d5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-438392909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bc55eb-eadb-4b31-98ad-15f85185423f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:20Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3e9ccf-e550-4ae4-a341-d0719a538a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3e9ccf-e550-4ae4-a341-d0719a538a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b48e62-d231-41f2-aebe-d336b61c890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19b48e62-d231-41f2-aebe-d336b61c890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28bc55eb-eadb-4b31-98ad-15f85185423f', 'volume_name': 'volume-28bc55eb-eadb-4b31-98ad-15f85185423f', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b8cf2-e4f3-4e48-b123-8f7faafad66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023b8cf2-e4f3-4e48-b123-8f7faafad66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda352b7-2b62-4f56-abbd-b0ae710cc1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Volume 28bc55eb-eadb-4b31-98ad-15f85185423f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28bc55eb-eadb-4b31-98ad-15f85185423f', 'volume_size': 1} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:20 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896" returned: 0 in 0.856s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-438392909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28bc55eb-eadb-4b31-98ad-15f85185423f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5604815553b48b394b98527fbfaa424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:20Z,use_quota=True,user_id='c95a6564472545178ffbdc5be4863fa9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Creating volume 28bc55eb-eadb-4b31-98ad-15f85185423f {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:20 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d490dd-4c1b-4be8-97c5-a4cc0f0aa717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7402c4-eae5-48ec-bcd7-7cd684284896', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f 1073741824 Apr 30 11:10:20 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaaeba2-c156-4e0a-ab2f-75a991efa255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Volume volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 (8c7402c4-eae5-48ec-bcd7-7cd684284896): created successfully Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaaeba2-c156-4e0a-ab2f-75a991efa255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Flow 'volume_create_manager' (bd31f24f-1cab-4d66-bfac-ace491cf7c2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e5682831-f284-4245-ba4b-068027f3df86 tempest-VolumesTransfersV357Test-505599764 None] Created volume successfully. Apr 30 11:10:20 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.903s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:20 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f3da8c61-1072-43a6-b92d-ef61d3f36982 tempest-GroupsV314Test-1698171399 None] Delete group completed successfully. Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Acquiring lock "cinder-quobyte-27bba761-a9ad-4447-abc2-3dd54372c6db" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-27bba761-a9ad-4447-abc2-3dd54372c6db" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d20d4-177a-4a08-9ac6-8321426f627c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:21 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:10:21 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:21 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-52b07de2-7acf-4339-833b-6492fab93baa tempest-VolumesTransfersV357Test-2003665217 None] Transfer volume completed successfully. Apr 30 11:10:21 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f 1073741824" returned: 0 in 1.568s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:22 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f Apr 30 11:10:22 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:22 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 1.111s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:22 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db Apr 30 11:10:22 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:22 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f" returned: 0 in 0.817s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda352b7-2b62-4f56-abbd-b0ae710cc1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28bc55eb-eadb-4b31-98ad-15f85185423f', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36edef05-6632-4800-bd50-554580aa455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:22 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Volume volume-28bc55eb-eadb-4b31-98ad-15f85185423f (28bc55eb-eadb-4b31-98ad-15f85185423f): created successfully Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36edef05-6632-4800-bd50-554580aa455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Flow 'volume_create_manager' (40960cf6-1830-42d5-971c-2d31050fe14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-12c16332-867a-4df5-a99f-670a7e6940a7 tempest-VolumesListTestJSON-1606200651 None] Created volume successfully. Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "cinder-8c7402c4-eae5-48ec-bcd7-7cd684284896-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-8c7402c4-eae5-48ec-bcd7-7cd684284896-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "cinder-quobyte-8c7402c4-eae5-48ec-bcd7-7cd684284896" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-quobyte-8c7402c4-eae5-48ec-bcd7-7cd684284896" acquired by "delete_volume" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82832ff6-a02b-4ba9-a867-aff7595a5c15]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:23 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 Apr 30 11:10:23 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:23 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27bba761-a9ad-4447-abc2-3dd54372c6db" returned: 0 in 0.979s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Lock "cinder-quobyte-27bba761-a9ad-4447-abc2-3dd54372c6db" released by "delete_volume" :: held 2.254s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Created reservations ['4cb33d1d-ace6-4692-88e3-de001d8851cd'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Created reservations ['73242d75-c1a6-4cd6-9427-acad0783457b', '11210720-5131-497b-b4b6-6294b020bccf', '94691598-b5e0-4605-bf7a-322e618dce90', 'bdcc9c9b-9cc1-475b-bd54-93b6e39a774a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:24 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:24 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:24 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896" returned: 0 in 1.694s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:24 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896 Apr 30 11:10:24 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:25 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.232s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:25 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:25 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bf450203-e7dd-49bf-9e56-ab988168e9e4 tempest-GroupsV314Test-1698171399 None] Delete group completed successfully. Apr 30 11:10:25 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8c7402c4-eae5-48ec-bcd7-7cd684284896" returned: 0 in 1.067s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-quobyte-8c7402c4-eae5-48ec-bcd7-7cd684284896" released by "delete_volume" :: held 2.816s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:25 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Created reservations ['ebdfb079-151d-4e0c-b5bf-a17469a2eb41', '468b9582-5517-444f-b0f9-d838a150374f', '6e59bd0c-5766-4285-9a03-22e78a265d21', '015df973-8f6f-4c1a-80c4-3c2faa58cc8c'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:26 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:26 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:27 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.052s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Deleted volume successfully. Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2bb4be8a-f981-40ac-b5ae-204d63043cf2 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-8c7402c4-eae5-48ec-bcd7-7cd684284896-delete_volume" released by "delete_volume" :: held 4.293s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Flow 'volume_create_manager' (f74b8753-4985-4d62-80f0-ce7902c805f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa77b78f-d9d6-4989-b282-fcb48552cdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-28bc55eb-eadb-4b31-98ad-15f85185423f-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa77b78f-d9d6-4989-b282-fcb48552cdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-626864394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dbdb0e-0991-4c05-92a6-9d1189a20f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46661579b4154e21895b987fbfca6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:27Z,use_quota=True,user_id='df1c3da1b66645d2ae93cf9306cfbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7bb799-b485-435e-9ce0-7ca227ae70de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7bb799-b485-435e-9ce0-7ca227ae70de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03855a06-51e4-404a-a176-9f1717994b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03855a06-51e4-404a-a176-9f1717994b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dbdb0e-0991-4c05-92a6-9d1189a20f95', 'volume_name': 'volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df71d51-9ec1-4a3e-9a88-cda22b2d0dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df71d51-9ec1-4a3e-9a88-cda22b2d0dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e51a86-a4a1-4881-af40-b5210ba5676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Volume 92dbdb0e-0991-4c05-92a6-9d1189a20f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95', 'volume_size': 1} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-626864394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dbdb0e-0991-4c05-92a6-9d1189a20f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46661579b4154e21895b987fbfca6042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:27Z,use_quota=True,user_id='df1c3da1b66645d2ae93cf9306cfbc64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Creating volume 92dbdb0e-0991-4c05-92a6-9d1189a20f95 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:27 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-28bc55eb-eadb-4b31-98ad-15f85185423f-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:27 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 1073741824 Apr 30 11:10:27 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-quobyte-28bc55eb-eadb-4b31-98ad-15f85185423f" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-28bc55eb-eadb-4b31-98ad-15f85185423f" acquired by "delete_volume" :: waited 0.039s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[939c5548-9e0a-4b89-9fe9-b37381569dbf]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Flow 'volume_create_manager' (f3217ab8-9dbf-4747-b08a-3e5439e6304c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42361fd-d5c3-48a8-9b93-65923211dfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42361fd-d5c3-48a8-9b93-65923211dfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-401824012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb22b23a-d46a-45cc-8fc9-47543be3a129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9310c3e0c14f3d8b2515522a977246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:28Z,use_quota=True,user_id='fae47e9b197e4e248d93ffe185b61ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade8f14-7b5b-427d-8a21-b9a4cadd365d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ade8f14-7b5b-427d-8a21-b9a4cadd365d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:28 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f Apr 30 11:10:28 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc27e5e8-4260-499a-8bf7-53025d04a384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc27e5e8-4260-499a-8bf7-53025d04a384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb22b23a-d46a-45cc-8fc9-47543be3a129', 'volume_name': 'volume-eb22b23a-d46a-45cc-8fc9-47543be3a129', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1d3356-ffd6-41d0-8609-0d629b5785b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1d3356-ffd6-41d0-8609-0d629b5785b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28c7c1-de75-44b8-b611-5b1734e2325d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:28 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Volume eb22b23a-d46a-45cc-8fc9-47543be3a129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb22b23a-d46a-45cc-8fc9-47543be3a129', 'volume_size': 1} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:28 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 1073741824" returned: 0 in 1.327s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:29 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 Apr 30 11:10:29 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:29 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f" returned: 0 in 1.251s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:29 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f Apr 30 11:10:29 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:30 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-28bc55eb-eadb-4b31-98ad-15f85185423f" returned: 0 in 1.006s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-28bc55eb-eadb-4b31-98ad-15f85185423f" released by "delete_volume" :: held 2.389s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:30 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95" returned: 0 in 1.205s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] <== create_volume: return (2625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.629s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-401824012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb22b23a-d46a-45cc-8fc9-47543be3a129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a9310c3e0c14f3d8b2515522a977246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:28Z,use_quota=True,user_id='fae47e9b197e4e248d93ffe185b61ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Creating volume eb22b23a-d46a-45cc-8fc9-47543be3a129 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:30 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e51a86-a4a1-4881-af40-b5210ba5676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478933ef-711c-4f2a-8afe-018e66387a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:30 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 1073741824 Apr 30 11:10:30 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:30 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Volume volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 (92dbdb0e-0991-4c05-92a6-9d1189a20f95): created successfully Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (478933ef-711c-4f2a-8afe-018e66387a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Flow 'volume_create_manager' (f74b8753-4985-4d62-80f0-ce7902c805f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Created reservations ['d9058971-48ea-4504-9c30-af6ea5f0c27f', '45834e86-94b4-4c67-adda-1ae2cb2dcf5d', '315bd79d-67d1-4c32-8a2f-df33296f0998', '97b7d43b-dfe5-4058-8c50-b23b99ea2dc2'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2299705a-6520-4da7-bf37-a59081b66f3f tempest-VolumesTransfersV357Test-505599764 None] Created volume successfully. Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:30 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:30 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-quobyte-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" acquired by "delete_volume" :: waited 0.056s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[25125f9b-8c0a-4d13-95fa-fff95b42021a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "cinder-92dbdb0e-0991-4c05-92a6-9d1189a20f95-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-92dbdb0e-0991-4c05-92a6-9d1189a20f95-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "cinder-quobyte-92dbdb0e-0991-4c05-92a6-9d1189a20f95" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-quobyte-92dbdb0e-0991-4c05-92a6-9d1189a20f95" acquired by "delete_volume" :: waited 0.063s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:31 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 Apr 30 11:10:31 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84786dd-eb2e-4932-9198-f9442b554de3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:32 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 1073741824" returned: 0 in 2.000s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:32 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 Apr 30 11:10:32 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:32 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.830s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:32 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Deleted volume successfully. Apr 30 11:10:32 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 Apr 30 11:10:32 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-81e850e0-fe4d-44c0-8de9-6ee810f0eb78 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-28bc55eb-eadb-4b31-98ad-15f85185423f-delete_volume" released by "delete_volume" :: held 4.733s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:33 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" returned: 0 in 1.864s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:33 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5 Apr 30 11:10:33 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:33 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95" returned: 0 in 1.670s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:33 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129" returned: 0 in 1.325s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] <== create_volume: return (3400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.403s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:33 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95 Apr 30 11:10:33 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28c7c1-de75-44b8-b611-5b1734e2325d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb22b23a-d46a-45cc-8fc9-47543be3a129', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b134a0-685e-4f2a-8be6-df9b91c16940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Volume volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 (eb22b23a-d46a-45cc-8fc9-47543be3a129): created successfully Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b134a0-685e-4f2a-8be6-df9b91c16940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Flow 'volume_create_manager' (f3217ab8-9dbf-4747-b08a-3e5439e6304c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:33 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-954dc864-a5a8-489d-ae2b-c73d01a425e6 tempest-ServerRescueNegativeTestJSON-387756146 None] Created volume successfully. Apr 30 11:10:34 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" returned: 0 in 1.080s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5" released by "delete_volume" :: held 3.038s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:34 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-92dbdb0e-0991-4c05-92a6-9d1189a20f95" returned: 0 in 0.900s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-quobyte-92dbdb0e-0991-4c05-92a6-9d1189a20f95" released by "delete_volume" :: held 2.658s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Created reservations ['613f35c9-9a50-44fb-9645-a106b3f7d6fa', 'd60f891c-9919-4233-bb21-eec84c34358f', '7a5a66e2-8294-4260-bd01-16548a6079f4', 'ef651ac3-09fb-4c61-826f-dbea2f8e253f'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Created reservations ['28af4e01-f6d3-49fc-a82b-c26aac06e72a', '90cdbb30-d3dd-495a-8840-be610b177c5c', 'ae341479-d7f0-4029-bfa4-7e69041b0d97', '6579dd68-9514-474c-a462-a1d8c4df43d3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c3a598b4-45d7-4024-950b-64c6002e47dc tempest-GroupsV320Test-1525097013 None] Group tempest-GroupsV320Test-Group-1465628546: creating Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:34 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:34 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c3a598b4-45d7-4024-950b-64c6002e47dc tempest-GroupsV320Test-1525097013 None] Group tempest-GroupsV320Test-Group-1465628546: created successfully Apr 30 11:10:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c3a598b4-45d7-4024-950b-64c6002e47dc tempest-GroupsV320Test-1525097013 None] Create group completed successfully. Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:34 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:34 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-98f66be3-fd3b-4446-a76e-f8c0d0348961-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-98f66be3-fd3b-4446-a76e-f8c0d0348961-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "cinder-quobyte-98f66be3-fd3b-4446-a76e-f8c0d0348961" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-98f66be3-fd3b-4446-a76e-f8c0d0348961" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bffaf9e-cd1c-4b40-86cc-4eb3e4c7c10f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:35 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 Apr 30 11:10:35 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:35 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.116s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Deleted volume successfully. Apr 30 11:10:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a9bc7026-abc7-4353-8929-5d80406f32d5 tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-0e3fb3b4-76ed-4d8b-9d41-968f2750b9c5-delete_volume" released by "delete_volume" :: held 4.641s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:36 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.617s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Deleted volume successfully. Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98683a63-2b57-4bb6-b67d-db0e8238e0c9 tempest-VolumesTransfersV357Test-2140579578 None] Lock "cinder-92dbdb0e-0991-4c05-92a6-9d1189a20f95-delete_volume" released by "delete_volume" :: held 4.817s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:36 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961" returned: 0 in 1.454s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:36 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961 Apr 30 11:10:36 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Created reservations ['ff614ec5-37d5-44d5-ac5e-820d524bbd0e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:37 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:37 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:37 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-98f66be3-fd3b-4446-a76e-f8c0d0348961" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-quobyte-98f66be3-fd3b-4446-a76e-f8c0d0348961" released by "delete_volume" :: held 2.465s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Created reservations ['bfff60dd-a459-40d4-9b31-6ce623455959', 'e92ebf73-2302-4bca-bd1b-0c0671bd6166', '19688bc9-76b0-40a6-8c9c-3f440f7468f0', '5c069ce0-4033-46ec-80b3-c697a2deaac0'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:38 devstack sudo[89856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:38 devstack sudo[89856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:38 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.055s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:38 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-75771dfa-b3ad-4f15-aef9-bb74487fc6f3 tempest-GroupsV320Test-1525097013 None] Delete group completed successfully. Apr 30 11:10:38 devstack sudo[89856]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.972s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:38 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Deleted volume successfully. Apr 30 11:10:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2cbc461-8482-4f37-a2b4-8109cb33a5da tempest-VolumesListTestJSON-1606200651 None] Lock "cinder-98f66be3-fd3b-4446-a76e-f8c0d0348961-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Flow 'volume_create_manager' (97c1beb7-62c5-4f06-8100-3844185b1f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7862d070-8274-4b92-b9b2-5155ef7ede9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7862d070-8274-4b92-b9b2-5155ef7ede9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-399032297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d64bea-1f39-4893-8ae8-c19712412aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e37aba0f60c4402a9382012a628b22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:43Z,use_quota=True,user_id='36f85834bde341fea9535f75eed88c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492505d2-b49d-4842-b6b2-3b1da28a2127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492505d2-b49d-4842-b6b2-3b1da28a2127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb3ad66-919e-4e98-a25f-ea6c90cf2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb3ad66-919e-4e98-a25f-ea6c90cf2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d64bea-1f39-4893-8ae8-c19712412aec', 'volume_name': 'volume-34d64bea-1f39-4893-8ae8-c19712412aec', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922551e0-c5e8-47fc-85a9-22a2750df1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922551e0-c5e8-47fc-85a9-22a2750df1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6684acd5-7ada-462c-8f4c-15fe4043cc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:43 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Volume 34d64bea-1f39-4893-8ae8-c19712412aec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d64bea-1f39-4893-8ae8-c19712412aec', 'volume_size': 1} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-399032297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d64bea-1f39-4893-8ae8-c19712412aec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e37aba0f60c4402a9382012a628b22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:43Z,use_quota=True,user_id='36f85834bde341fea9535f75eed88c0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Creating volume 34d64bea-1f39-4893-8ae8-c19712412aec {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:43 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:43 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec 1073741824 Apr 30 11:10:43 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:44 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec 1073741824" returned: 0 in 1.175s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:44 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec Apr 30 11:10:44 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:46 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec" returned: 0 in 1.798s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] <== create_volume: return (3037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.040s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6684acd5-7ada-462c-8f4c-15fe4043cc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d64bea-1f39-4893-8ae8-c19712412aec', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2c42bb-ad47-4656-86f1-b7249a987e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Volume volume-34d64bea-1f39-4893-8ae8-c19712412aec (34d64bea-1f39-4893-8ae8-c19712412aec): created successfully Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2c42bb-ad47-4656-86f1-b7249a987e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Flow 'volume_create_manager' (97c1beb7-62c5-4f06-8100-3844185b1f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4fbf0cce-ad66-4ebd-9c1c-b5e7cf83cf86 tempest-VolumesNegativeTest-528409450 None] Created volume successfully. Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Flow 'volume_create_manager' (239aa716-20c4-4235-8e12-f714aaf070ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b935359-3cf4-47d9-bcb8-334de493bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b935359-3cf4-47d9-bcb8-334de493bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-143438099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c6ae7-36ca-42a1-9f78-9b19065ad49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd039ae084824cce89a0b5196cf26770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:47Z,use_quota=True,user_id='9d85a6ec7f074334b81dd15669e4577a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3c46bc-b591-4551-93e8-b212d56064e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3c46bc-b591-4551-93e8-b212d56064e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb53e4d-62f9-4322-bf9b-ff5fd9608f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb53e4d-62f9-4322-bf9b-ff5fd9608f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '174c6ae7-36ca-42a1-9f78-9b19065ad49a', 'volume_name': 'volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82744aa-fcf9-48eb-b0e4-522403bd5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82744aa-fcf9-48eb-b0e4-522403bd5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2622db-a857-4a9e-afe8-d3cd03add230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:46 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a', 'volume_size': 1} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-143438099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=174c6ae7-36ca-42a1-9f78-9b19065ad49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd039ae084824cce89a0b5196cf26770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:47Z,use_quota=True,user_id='9d85a6ec7f074334b81dd15669e4577a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Creating volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:46 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:47 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a 1073741824 Apr 30 11:10:47 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:48 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a 1073741824" returned: 0 in 1.824s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:49 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a Apr 30 11:10:49 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:50 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a" returned: 0 in 1.244s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] <== create_volume: return (3312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.318s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2622db-a857-4a9e-afe8-d3cd03add230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9d3b0-a5e9-4c50-accf-76ac2f340b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Volume volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a (174c6ae7-36ca-42a1-9f78-9b19065ad49a): created successfully Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a9d3b0-a5e9-4c50-accf-76ac2f340b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Flow 'volume_create_manager' (239aa716-20c4-4235-8e12-f714aaf070ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-57368a0f-2616-4593-b947-1a5dd1c9adbd tempest-SnapshotsActionsTest-25418463 None] Created volume successfully. Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Creating offline snapshot 6bb524fb-b038-4129-9f6d-70d844cf63ec of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07a0a49-cfc3-4ae7-ab62-f9dd48776004]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Flow 'volume_create_manager' (b6e0bd70-5006-4334-9e7f-ea39ec777b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889283ab-1570-4f91-8cda-9f2dd834bc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (889283ab-1570-4f91-8cda-9f2dd834bc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-524142736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5498f3-52da-490b-96e8-9b96b19f4d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641a89a714ff46788acafc7631ddd8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:52Z,use_quota=True,user_id='ac99e6a7f80340f7a3d14148f3658d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:51 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a Apr 30 11:10:51 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc9b66-6d7d-484a-9c50-6a8d36a6f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dfc9b66-6d7d-484a-9c50-6a8d36a6f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcf96dc-f7fd-4be1-a4fd-fadef0f49257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcf96dc-f7fd-4be1-a4fd-fadef0f49257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5498f3-52da-490b-96e8-9b96b19f4d07', 'volume_name': 'volume-1f5498f3-52da-490b-96e8-9b96b19f4d07', 'volume_size': 2}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30397f3-f8c1-4618-98ff-2480c7dcae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b30397f3-f8c1-4618-98ff-2480c7dcae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9821125f-34fd-4898-99a2-18d80b9c5798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:10:51 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Volume 1f5498f3-52da-490b-96e8-9b96b19f4d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5498f3-52da-490b-96e8-9b96b19f4d07', 'volume_size': 2} Apr 30 11:10:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:52 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a" returned: 0 in 1.166s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:52 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec 1G Apr 30 11:10:52 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:53 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec 1G" returned: 0 in 1.072s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:53 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:10:53 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Acquiring lock "cinder-eb22b23a-d46a-45cc-8fc9-47543be3a129-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "cinder-eb22b23a-d46a-45cc-8fc9-47543be3a129-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Acquiring lock "cinder-quobyte-eb22b23a-d46a-45cc-8fc9-47543be3a129" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:10:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "cinder-quobyte-eb22b23a-d46a-45cc-8fc9-47543be3a129" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:10:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d362e-38c9-4b3f-879c-5e5bdb05a6c7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:10:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:55 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 Apr 30 11:10:55 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:55 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 1.306s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:55 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec is being set with open permissions: ugo+rw Apr 30 11:10:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:55 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:10:55 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:56 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 1.033s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:56 devstack sudo[90153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info Apr 30 11:10:56 devstack sudo[90153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:56 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129" returned: 0 in 1.312s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:56 devstack sudo[90158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129 Apr 30 11:10:56 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:57 devstack sudo[90153]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info" returned: 0 in 0.796s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:57 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info is being set with open permissions: ugo+rw Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:57 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info Apr 30 11:10:57 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:57 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eb22b23a-d46a-45cc-8fc9-47543be3a129" returned: 0 in 0.925s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "cinder-quobyte-eb22b23a-d46a-45cc-8fc9-47543be3a129" released by "delete_volume" :: held 2.297s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Created reservations ['1fc1d505-c7c0-47b3-bc36-6401e8f528d6', '4381df2c-dac7-4a3e-a631-6b45bbb8c820', 'b67fa21c-fc8e-4d50-a63d-a92ec976e3e3', 'beba8325-58f1-46b9-bbe6-f863626ee279'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:57 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:10:57 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:57 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.info" returned: 0 in 0.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.365s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.054s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-524142736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5498f3-52da-490b-96e8-9b96b19f4d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641a89a714ff46788acafc7631ddd8cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:10:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:10:52Z,use_quota=True,user_id='ac99e6a7f80340f7a3d14148f3658d11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Creating volume 1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:10:57 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:10:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 2147483648 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:58 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 2147483648 Apr 30 11:10:58 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:10:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-65159cd5-8f30-4aa3-907e-d157ed6c68db tempest-SnapshotsActionsTest-25418463 None] Create snapshot completed successfully Apr 30 11:10:58 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.978s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:58 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:10:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Deleted volume successfully. Apr 30 11:10:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f5fdf02b-850c-4cc6-bd39-98f72df0a0c5 tempest-ServerRescueNegativeTestJSON-387756146 None] Lock "cinder-eb22b23a-d46a-45cc-8fc9-47543be3a129-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:10:59 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 30 11:10:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 2147483648" returned: 0 in 1.132s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:10:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:10:59 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 Apr 30 11:10:59 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:00 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07" returned: 0 in 1.037s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.246s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.182s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9821125f-34fd-4898-99a2-18d80b9c5798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5498f3-52da-490b-96e8-9b96b19f4d07', 'volume_size': 2}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e527541b-4662-4cd9-8a22-0e2a709f0555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Creating offline snapshot 8b9faa40-69d1-47fa-b2b3-f2110207a3eb of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:00 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Volume volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 (1f5498f3-52da-490b-96e8-9b96b19f4d07): created successfully Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e527541b-4662-4cd9-8a22-0e2a709f0555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Flow 'volume_create_manager' (b6e0bd70-5006-4334-9e7f-ea39ec777b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f62948-5b1e-4c9b-93a0-9bc2a36785fa]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-605c0b2d-da2c-4a50-b2af-1fb03a2e0308 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Created volume successfully. Apr 30 11:11:00 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:00 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:01 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 1.190s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:01 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb 1G Apr 30 11:11:01 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:02 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb 1G" returned: 0 in 1.026s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:02 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb Apr 30 11:11:02 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:03 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb" returned: 0 in 0.666s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:03 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb is being set with open permissions: ugo+rw Apr 30 11:11:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:03 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb Apr 30 11:11:03 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:04 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb" returned: 0 in 1.280s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.462s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.576s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Creating offline snapshot 07ef8721-5443-4b26-9678-2b1003acaae1 of volume 1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-28ce49d2-9dfb-4ef4-afb2-7faa06e85464 tempest-SnapshotsActionsTest-25418463 None] Create snapshot completed successfully Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bba8d54-b408-4883-b34b-7d04288b7b21]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:04 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 Apr 30 11:11:04 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-8b9faa40-69d1-47fa-b2b3-f2110207a3eb-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-8b9faa40-69d1-47fa-b2b3-f2110207a3eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-8b9faa40-69d1-47fa-b2b3-f2110207a3eb" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-8b9faa40-69d1-47fa-b2b3-f2110207a3eb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Deleting offline snapshot 8b9faa40-69d1-47fa-b2b3-f2110207a3eb of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] snapshot_file for this snap is: volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6187691-b4a9-4e4e-9455-8cc7514255eb]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:05 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb Apr 30 11:11:05 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:05 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07" returned: 0 in 1.053s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 2G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:05 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 2G Apr 30 11:11:05 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:06 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb" returned: 0 in 1.128s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12e7464-63a0-4796-832d-86c4fbb40a38]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:06 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:06 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:07 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:07 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:07 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 2G" returned: 0 in 1.318s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:07 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 Apr 30 11:11:07 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:07 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 1.153s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:08 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.030s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:08 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb Apr 30 11:11:08 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:08 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1" returned: 0 in 1.038s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:08 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 is being set with open permissions: ugo+rw Apr 30 11:11:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:08 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 Apr 30 11:11:08 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:09 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb" returned: 0 in 1.205s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:09 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb Apr 30 11:11:09 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:09 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1" returned: 0 in 1.287s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=104,cinder:SELECT=84,cinder:INSERT=27,cinder:DELETE=8 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=76,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=17 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:11:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:09 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info Apr 30 11:11:09 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:10 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.8b9faa40-69d1-47fa-b2b3-f2110207a3eb" returned: 0 in 1.023s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-8b9faa40-69d1-47fa-b2b3-f2110207a3eb" released by "_delete_snapshot" :: held 4.644s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_snapshot" :: held 4.701s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Created reservations ['1671abb4-2244-4a11-8d19-9eb1a2c2bdfa', 'd25a0075-6bd2-4797-b89d-8169cd6b3cab', '89f5219a-cd4d-4024-9fa0-5dbc1777bc13', '48cd4886-92f9-443f-b10d-f8723082b349'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Delete snapshot completed successfully. Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea82327d-3bf8-4fb1-9645-8a73b05a887f tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-8b9faa40-69d1-47fa-b2b3-f2110207a3eb-delete_snapshot" released by "delete_snapshot" :: held 5.073s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:10 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info" returned: 0 in 1.187s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:10 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info is being set with open permissions: ugo+rw Apr 30 11:11:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:10 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info Apr 30 11:11:10 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:11 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.info" returned: 0 in 0.922s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.045s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.095s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Creating offline snapshot 15060c3c-baab-41d0-ae9a-806e6cfd103f of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-80a3953d-4df3-4348-8413-6494ab015650 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Create snapshot completed successfully Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0ca707-5dc4-41dd-b927-67aa7f4ce17f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:11 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:11 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:12 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.854s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:12 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f 1G Apr 30 11:11:12 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "cinder-07ef8721-5443-4b26-9678-2b1003acaae1-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-07ef8721-5443-4b26-9678-2b1003acaae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "cinder-quobyte-07ef8721-5443-4b26-9678-2b1003acaae1" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-07ef8721-5443-4b26-9678-2b1003acaae1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Deleting offline snapshot 07ef8721-5443-4b26-9678-2b1003acaae1 of volume 1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] snapshot_file for this snap is: volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff467d0-20d1-4208-a2f8-8b3dedd4cb1d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:13 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 Apr 30 11:11:13 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:13 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f 1G" returned: 0 in 0.861s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:13 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f Apr 30 11:11:13 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:13 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1" returned: 0 in 0.801s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f5498f3-52da-490b-96e8-9b96b19f4d07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429d145-1e89-47db-bdf7-c8c16f5ca303]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:14 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 Apr 30 11:11:14 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:14 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f" returned: 0 in 0.709s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:14 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f is being set with open permissions: ugo+rw Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:14 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f Apr 30 11:11:14 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:14 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07" returned: 0 in 0.948s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:14 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 Apr 30 11:11:14 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:14 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f" returned: 0 in 0.672s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.221s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d7012023-855b-431d-8df5-03ae134d0eea tempest-SnapshotsActionsTest-25418463 None] Create snapshot completed successfully Apr 30 11:11:15 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1" returned: 0 in 0.774s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:15 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1 Apr 30 11:11:15 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-15060c3c-baab-41d0-ae9a-806e6cfd103f-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-15060c3c-baab-41d0-ae9a-806e6cfd103f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-15060c3c-baab-41d0-ae9a-806e6cfd103f" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-15060c3c-baab-41d0-ae9a-806e6cfd103f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Deleting offline snapshot 15060c3c-baab-41d0-ae9a-806e6cfd103f of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] snapshot_file for this snap is: volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f7933a-d200-4676-9a7f-740c73746dd7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:16 devstack sudo[90529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f Apr 30 11:11:16 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:16 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07.07ef8721-5443-4b26-9678-2b1003acaae1" returned: 0 in 0.780s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-07ef8721-5443-4b26-9678-2b1003acaae1" released by "_delete_snapshot" :: held 3.446s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" released by "delete_snapshot" :: held 3.481s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Created reservations ['4e866795-eeca-4ed5-a6ea-81d0a169b935', 'f45b57cd-110d-448d-b625-3350da7b1d4d', '96947f56-a7b8-4dd1-909b-0a61db8ea5e7', 'f378183b-f293-4c57-b3ef-1e889f71f19d'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:16 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Delete snapshot completed successfully. Apr 30 11:11:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-88bf03f2-969f-4676-af75-ec6dbfb5b5ac tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-07ef8721-5443-4b26-9678-2b1003acaae1-delete_snapshot" released by "delete_snapshot" :: held 3.659s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:17 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f" returned: 0 in 0.936s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cafb45-ff72-4f15-9b10-f54d56281235]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:17 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:17 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "cinder-1f5498f3-52da-490b-96e8-9b96b19f4d07-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-1f5498f3-52da-490b-96e8-9b96b19f4d07-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b758b807-d9b2-41f8-be61-aa524fae5e6e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:17 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 Apr 30 11:11:17 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:18 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 1.023s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:18 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f Apr 30 11:11:18 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:18 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07" returned: 0 in 0.979s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:18 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07 Apr 30 11:11:18 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:19 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f" returned: 0 in 0.904s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:19 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f Apr 30 11:11:19 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:19 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1f5498f3-52da-490b-96e8-9b96b19f4d07" returned: 0 in 0.847s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-quobyte-1f5498f3-52da-490b-96e8-9b96b19f4d07" released by "delete_volume" :: held 1.905s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Created reservations ['42d8268a-f83d-415c-a8cb-554baa00b5f7', 'dda69325-320a-40af-9263-1d7f80cd58f0', '5be7e006-9051-441d-aaae-ed647c8dadd1', 'c6631df2-70cf-490f-89be-e167f6ca51b4'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:19 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:19 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:19 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.15060c3c-baab-41d0-ae9a-806e6cfd103f" returned: 0 in 0.744s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-15060c3c-baab-41d0-ae9a-806e6cfd103f" released by "_delete_snapshot" :: held 3.756s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_snapshot" :: held 3.790s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:19 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Created reservations ['0ecb9ebe-ee44-4049-932b-89dbf9e0e521', '721d190b-47ef-4890-9986-a056e3d1e533', 'aa23cc06-1d94-4862-a3a0-ab253fc58950', '061cd7fe-3c8d-4b90-ad85-7df75964cfc6'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Delete snapshot completed successfully. Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9b600c2d-5a7a-4089-913e-70e8229c51af tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-15060c3c-baab-41d0-ae9a-806e6cfd103f-delete_snapshot" released by "delete_snapshot" :: held 3.969s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:20 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.691s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Deleted volume successfully. Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2030952b-817d-4845-a29a-1cee356427c8 tempest-VolumesSnapshotNegativeTestJSON-2002128197 None] Lock "cinder-1f5498f3-52da-490b-96e8-9b96b19f4d07-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Creating offline snapshot 53f4e93a-2ee4-4353-9d3f-33b7755b15b2 of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6217d17e-c25f-42bc-ab67-d2d07d9e01e9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:20 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:20 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:21 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.939s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:21 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 1G Apr 30 11:11:21 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:22 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 1G" returned: 0 in 0.997s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:22 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 Apr 30 11:11:22 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:23 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2" returned: 0 in 0.813s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:23 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 is being set with open permissions: ugo+rw Apr 30 11:11:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:23 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 Apr 30 11:11:23 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (716efe8b-0364-40fa-8827-678ca7dd6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c63b95-4413-4940-8eb5-20b40f860934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c63b95-4413-4940-8eb5-20b40f860934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604750411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27132986-d74f-4155-82cc-e4460b33538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:24Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ed2652-e8b7-49de-b85b-06989e365349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31ed2652-e8b7-49de-b85b-06989e365349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ceef22-7242-4ae4-a8da-cff4e180602b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56ceef22-7242-4ae4-a8da-cff4e180602b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27132986-d74f-4155-82cc-e4460b33538d', 'volume_name': 'volume-27132986-d74f-4155-82cc-e4460b33538d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b728346d-f1a0-4de3-a3d6-ef64959e1ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b728346d-f1a0-4de3-a3d6-ef64959e1ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f59b05-f4c4-4f6f-a887-4b611a3623a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Volume 27132986-d74f-4155-82cc-e4460b33538d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27132986-d74f-4155-82cc-e4460b33538d', 'volume_size': 1} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:24 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2" returned: 0 in 1.032s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.943s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1604750411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27132986-d74f-4155-82cc-e4460b33538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:24Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Creating volume 27132986-d74f-4155-82cc-e4460b33538d {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:24 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:24 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d 1073741824 Apr 30 11:11:24 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3db1bc2f-fe10-451f-9078-044590874408 tempest-SnapshotsActionsTest-25418463 None] Create snapshot completed successfully Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (b38fc085-83d4-4b57-b38c-8d6b59684e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb7cde8-d6c6-4b98-b652-a1edde00d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Acquiring lock "cinder-34d64bea-1f39-4893-8ae8-c19712412aec-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb7cde8-d6c6-4b98-b652-a1edde00d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1748046322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb682b93-e0fa-4d39-87e7-8ebdfe811c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:25Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fad099a-9ea2-4388-a213-e4a2fe03fdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fad099a-9ea2-4388-a213-e4a2fe03fdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5ffcf8-c28a-46eb-943d-7327c31c3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d5ffcf8-c28a-46eb-943d-7327c31c3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb682b93-e0fa-4d39-87e7-8ebdfe811c77', 'volume_name': 'volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a48d67e-a9d1-4dd7-8dfc-be63d1452631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a48d67e-a9d1-4dd7-8dfc-be63d1452631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b9d5a1-7bf6-4495-b131-4dd6ba4dd1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Volume cb682b93-e0fa-4d39-87e7-8ebdfe811c77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77', 'volume_size': 1} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "cinder-34d64bea-1f39-4893-8ae8-c19712412aec-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Acquiring lock "cinder-quobyte-34d64bea-1f39-4893-8ae8-c19712412aec" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "cinder-quobyte-34d64bea-1f39-4893-8ae8-c19712412aec" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61fa45-210c-4a3a-abb0-3a4f1054141e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:25 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec Apr 30 11:11:25 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-53f4e93a-2ee4-4353-9d3f-33b7755b15b2-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-53f4e93a-2ee4-4353-9d3f-33b7755b15b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (4e67db51-458e-4146-81b6-d2845ef16853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffee6d4b-230d-46fb-904f-04110ffbb7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffee6d4b-230d-46fb-904f-04110ffbb7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716320601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f11ae-a651-4fcb-acab-15d24ceeb096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:25Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c82c17-7f5b-4c5e-a9c1-1f1254e51882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c82c17-7f5b-4c5e-a9c1-1f1254e51882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a7ddc6-c04a-4bd2-9ddc-49d36c2657de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a7ddc6-c04a-4bd2-9ddc-49d36c2657de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3f11ae-a651-4fcb-acab-15d24ceeb096', 'volume_name': 'volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f913e-a596-4ccc-843e-41272ea49854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (006f913e-a596-4ccc-843e-41272ea49854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d549880c-18f9-43f9-92b7-b2f3f371d2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Volume 9c3f11ae-a651-4fcb-acab-15d24ceeb096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096', 'volume_size': 1} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_snapshot" :: waited 0.153s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-53f4e93a-2ee4-4353-9d3f-33b7755b15b2" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-53f4e93a-2ee4-4353-9d3f-33b7755b15b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Deleting offline snapshot 53f4e93a-2ee4-4353-9d3f-33b7755b15b2 of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] snapshot_file for this snap is: volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a67df38-03bd-49b2-b5d4-dbf44211cb3a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (01290fe7-6c57-4ca3-872e-3686a5928476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c1b1d-51f4-4dbb-ad52-95d095e00cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845c1b1d-51f4-4dbb-ad52-95d095e00cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136946248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dabc6c7-1787-4612-95e5-9dda7b054cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:26Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5fd358-282a-4ae6-8f6b-8a678f8bd403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5fd358-282a-4ae6-8f6b-8a678f8bd403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 Apr 30 11:11:25 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b248ce3-aaa5-44b0-9a3f-7e22c2fcc0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b248ce3-aaa5-44b0-9a3f-7e22c2fcc0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dabc6c7-1787-4612-95e5-9dda7b054cf2', 'volume_name': 'volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4239c9d2-24d6-4c1f-b06f-03fc503e0f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4239c9d2-24d6-4c1f-b06f-03fc503e0f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c600e4ce-33bf-42e7-871f-e91945fdf8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Volume 4dabc6c7-1787-4612-95e5-9dda7b054cf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2', 'volume_size': 1} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:26 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d 1073741824" returned: 0 in 1.353s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:26 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec" returned: 0 in 1.084s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:26 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d Apr 30 11:11:26 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:26 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec Apr 30 11:11:26 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (31b13be5-f1d0-41b6-974c-f5d60fc7cb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6fa632-e964-47af-9db6-805fee4595b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6fa632-e964-47af-9db6-805fee4595b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433630876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3825528d-cff9-476f-a44c-6617b27e29bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:26Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18144366-1572-4495-a1e9-8341fbd2d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18144366-1572-4495-a1e9-8341fbd2d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994ec0d-2631-4690-91ee-1909e868e5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b994ec0d-2631-4690-91ee-1909e868e5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3825528d-cff9-476f-a44c-6617b27e29bc', 'volume_name': 'volume-3825528d-cff9-476f-a44c-6617b27e29bc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985e84d5-9985-4ab3-a784-d66b7760ae04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985e84d5-9985-4ab3-a784-d66b7760ae04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff075bcc-4ae5-417c-bef1-16fa03e39027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Volume 3825528d-cff9-476f-a44c-6617b27e29bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3825528d-cff9-476f-a44c-6617b27e29bc', 'volume_size': 1} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:26 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2" returned: 0 in 1.246s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcbeadd-b548-4f1d-8142-f7edf3ba15a7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:27 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d" returned: 0 in 0.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.076s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1748046322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb682b93-e0fa-4d39-87e7-8ebdfe811c77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:25Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Creating volume cb682b93-e0fa-4d39-87e7-8ebdfe811c77 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:27 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f59b05-f4c4-4f6f-a887-4b611a3623a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27132986-d74f-4155-82cc-e4460b33538d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:27 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 1073741824 Apr 30 11:11:27 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1963ed79-0221-4a2f-8e67-16bc57ad836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-34d64bea-1f39-4893-8ae8-c19712412aec" returned: 0 in 0.889s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "cinder-quobyte-34d64bea-1f39-4893-8ae8-c19712412aec" released by "delete_volume" :: held 2.059s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:27 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:27 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Volume volume-27132986-d74f-4155-82cc-e4460b33538d (27132986-d74f-4155-82cc-e4460b33538d): created successfully Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1963ed79-0221-4a2f-8e67-16bc57ad836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (716efe8b-0364-40fa-8827-678ca7dd6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c7bd3a2b-39c6-425e-a78e-86d74893035f tempest-CreateVolumesFromImageTest-1269609395 None] Created volume successfully. Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Created reservations ['264c4341-89c2-4cb9-bfa4-117702475495', 'd57a8406-ba34-45c7-8a62-68a7e1bc4e2d', '3eb85971-1fcb-47a7-bc6d-b4708bf96b31', 'c0532c13-840e-42ab-a485-1f0916232c63'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:27 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:27 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:27 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0a20cccb-80c1-4d2f-b3ef-8b7da7a2036e tempest-GroupsTest-568995896 None] Group tempest-Group1-1698639591: creating Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.912s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:27 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 Apr 30 11:11:27 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0a20cccb-80c1-4d2f-b3ef-8b7da7a2036e tempest-GroupsTest-568995896 None] Group tempest-Group1-1698639591: created successfully Apr 30 11:11:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0a20cccb-80c1-4d2f-b3ef-8b7da7a2036e tempest-GroupsTest-568995896 None] Create group completed successfully. Apr 30 11:11:27 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 1073741824" returned: 0 in 0.941s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:28 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 Apr 30 11:11:28 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:28 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.757s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Deleted volume successfully. Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6b7014c2-012c-4ef9-afeb-753d906364c5 tempest-VolumesNegativeTest-528409450 None] Lock "cinder-34d64bea-1f39-4893-8ae8-c19712412aec-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:28 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" returned: 0 in 0.647s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1716320601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c3f11ae-a651-4fcb-acab-15d24ceeb096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:25Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Creating volume 9c3f11ae-a651-4fcb-acab-15d24ceeb096 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:28 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b9d5a1-7bf6-4495-b131-4dd6ba4dd1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 1073741824 Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9db94f-36e4-4860-b5fc-5261e207020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:28 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:28 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Volume volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 (cb682b93-e0fa-4d39-87e7-8ebdfe811c77): created successfully Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b9db94f-36e4-4860-b5fc-5261e207020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (b38fc085-83d4-4b57-b38c-8d6b59684e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dea9f181-0324-454c-9946-064bf71a2fa7 tempest-CreateVolumesFromImageTest-1269609395 None] Created volume successfully. Apr 30 11:11:28 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2" returned: 0 in 0.851s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:28 devstack sudo[90636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2 Apr 30 11:11:28 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a7435d92-9a9d-467c-8995-4bb159a0994b tempest-GroupsTest-568995896 None] Group tempest-Group2-1858246855: creating Apr 30 11:11:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a7435d92-9a9d-467c-8995-4bb159a0994b tempest-GroupsTest-568995896 None] Group tempest-Group2-1858246855: created successfully Apr 30 11:11:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a7435d92-9a9d-467c-8995-4bb159a0994b tempest-GroupsTest-568995896 None] Create group completed successfully. Apr 30 11:11:29 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.53f4e93a-2ee4-4353-9d3f-33b7755b15b2" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-53f4e93a-2ee4-4353-9d3f-33b7755b15b2" released by "_delete_snapshot" :: held 3.918s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_snapshot" :: held 3.951s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:29 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 1073741824" returned: 0 in 0.913s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Created reservations ['f81c7f04-90c7-4cef-a151-8d286d7e8d9c', '960f5ceb-9d7f-4dd9-9fe8-7fe46fd1dc1b', '4a94cf59-500b-4802-97ed-2cd8713235bc', '99b4804f-0b52-4bf9-ad5a-d661d4508a76'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:29 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 Apr 30 11:11:29 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Delete snapshot completed successfully. Apr 30 11:11:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dc89e4f2-7f06-4f2d-9f99-9d484e0fb039 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-53f4e93a-2ee4-4353-9d3f-33b7755b15b2-delete_snapshot" released by "delete_snapshot" :: held 4.277s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:30 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096" returned: 0 in 0.648s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.291s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-136946248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dabc6c7-1787-4612-95e5-9dda7b054cf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:26Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Creating volume 4dabc6c7-1787-4612-95e5-9dda7b054cf2 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:30 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d549880c-18f9-43f9-92b7-b2f3f371d2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:30 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 1073741824 Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79242d-4d15-446d-b93f-1074329864ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:30 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:30 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Volume volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 (9c3f11ae-a651-4fcb-acab-15d24ceeb096): created successfully Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db79242d-4d15-446d-b93f-1074329864ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (4e67db51-458e-4146-81b6-d2845ef16853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-42b307e3-3134-441f-b7e9-dd57cb4a7b94 tempest-CreateVolumesFromImageTest-1269609395 None] Created volume successfully. Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (80b36e04-3b5b-494a-9f9d-cdccd6f7068b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbcc9cf-f632-46cb-8145-5c1ae46d6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbcc9cf-f632-46cb-8145-5c1ae46d6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489134054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4e7fce9-d10f-4260-8630-204ccc63cd98,host='devstack@QuobyteHD#QuobyteHD',id=c623f3e1-c6d7-42d7-b99a-cac19a11c6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:31Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18021779-cace-4df7-a1a5-8a143f3faed8),volume_type_id=18021779-cace-4df7-a1a5-8a143f3faed8)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b8ca8-2e15-41f3-9cb6-c9808dfd1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5b8ca8-2e15-41f3-9cb6-c9808dfd1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc7607-adbd-41a5-9ea7-7785bdfaa90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39dc7607-adbd-41a5-9ea7-7785bdfaa90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c623f3e1-c6d7-42d7-b99a-cac19a11c6f4', 'volume_name': 'volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be75844-095e-4b0e-b4a0-0419e191366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be75844-095e-4b0e-b4a0-0419e191366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee84b6cd-72b1-4e7c-bbbc-edab187a6f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Volume c623f3e1-c6d7-42d7-b99a-cac19a11c6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4', 'volume_size': 1} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:31 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 1073741824" returned: 0 in 1.114s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:31 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 Apr 30 11:11:31 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:32 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2" returned: 0 in 0.669s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.512s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433630876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3825528d-cff9-476f-a44c-6617b27e29bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d28ae8172e40968863e51ee08d772c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:26Z,use_quota=True,user_id='8c7da7a2c1514df9b940dee6820a4703',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Creating volume 3825528d-cff9-476f-a44c-6617b27e29bc {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:32 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c600e4ce-33bf-42e7-871f-e91945fdf8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:32 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc 1073741824 Apr 30 11:11:32 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a94e81-6fb0-4c2f-b9de-72050da28cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Volume volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 (4dabc6c7-1787-4612-95e5-9dda7b054cf2): created successfully Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a94e81-6fb0-4c2f-b9de-72050da28cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (01290fe7-6c57-4ca3-872e-3686a5928476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-eb0d9685-211f-4958-9998-a04ac3488b97 tempest-CreateVolumesFromImageTest-1269609395 None] Created volume successfully. Apr 30 11:11:32 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc 1073741824" returned: 0 in 0.861s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:33 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc Apr 30 11:11:33 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:33 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc" returned: 0 in 0.668s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.642s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a4e7fce9-d10f-4260-8630-204ccc63cd98,created_at=2026-04-30T09:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489134054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a4e7fce9-d10f-4260-8630-204ccc63cd98,host='devstack@QuobyteHD#QuobyteHD',id=c623f3e1-c6d7-42d7-b99a-cac19a11c6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:31Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(18021779-cace-4df7-a1a5-8a143f3faed8),volume_type_id=18021779-cace-4df7-a1a5-8a143f3faed8)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Creating volume c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:33 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:33 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 1073741824 Apr 30 11:11:33 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff075bcc-4ae5-417c-bef1-16fa03e39027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3825528d-cff9-476f-a44c-6617b27e29bc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7afc17-b768-4337-ac90-1e4bf7a59683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Volume volume-3825528d-cff9-476f-a44c-6617b27e29bc (3825528d-cff9-476f-a44c-6617b27e29bc): created successfully Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7afc17-b768-4337-ac90-1e4bf7a59683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Flow 'volume_create_manager' (31b13be5-f1d0-41b6-974c-f5d60fc7cb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:33 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-57bb59f3-9173-4a71-8db5-6ca7280bd270 tempest-CreateVolumesFromImageTest-1269609395 None] Created volume successfully. Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-3825528d-cff9-476f-a44c-6617b27e29bc-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-3825528d-cff9-476f-a44c-6617b27e29bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-quobyte-3825528d-cff9-476f-a44c-6617b27e29bc" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-3825528d-cff9-476f-a44c-6617b27e29bc" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5718ec-ada4-417e-8709-04ff956c110b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:34 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc Apr 30 11:11:34 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:34 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 1073741824" returned: 0 in 0.944s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:34 devstack sudo[90672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 Apr 30 11:11:34 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:35 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" returned: 0 in 0.621s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.238s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:35 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee84b6cd-72b1-4e7c-bbbc-edab187a6f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a0a49-7904-4585-a3d5-4b35ab3dec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Creating offline snapshot 09b6387d-0909-49dc-850b-55db90c6f46a of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc" returned: 0 in 0.949s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:35 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Volume volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 (c623f3e1-c6d7-42d7-b99a-cac19a11c6f4): created successfully Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (262a0a49-7904-4585-a3d5-4b35ab3dec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (80b36e04-3b5b-494a-9f9d-cdccd6f7068b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:35 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0262a1-9c54-46a0-a053-8a0303a431b2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:35 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b1057ecd-e0a9-41c9-a52d-cfbdcef82706 tempest-GroupsTest-568995896 None] Created volume successfully. Apr 30 11:11:35 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:35 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:36 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3825528d-cff9-476f-a44c-6617b27e29bc" returned: 0 in 0.758s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-3825528d-cff9-476f-a44c-6617b27e29bc" released by "delete_volume" :: held 1.762s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Created reservations ['2466ea1f-f861-470e-bd9e-609399b5a546', '04e7db16-4013-4662-81cf-3034ebe24a3c', '1209e7ab-43cc-4a15-a441-2de07e880000', '088ae04a-e199-48b6-bc46-02402368df51'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:36 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.887s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:36 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a 1G Apr 30 11:11:36 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:36 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:36 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-4dabc6c7-1787-4612-95e5-9dda7b054cf2-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-4dabc6c7-1787-4612-95e5-9dda7b054cf2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-quobyte-4dabc6c7-1787-4612-95e5-9dda7b054cf2" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-4dabc6c7-1787-4612-95e5-9dda7b054cf2" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d05de-3050-4749-aa90-cf150e35cd96]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:37 devstack sudo[90690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 Apr 30 11:11:37 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Acquiring lock "cinder-quobyte-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" acquired by "delete_volume" :: waited 0.038s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:37 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.865s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e61e7-e6f1-4d7e-a8ca-5d074f1ccaa5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Deleted volume successfully. Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2aca13eb-ccb5-4c99-8197-39d04b424735 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-3825528d-cff9-476f-a44c-6617b27e29bc-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:37 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 Apr 30 11:11:37 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:37 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a 1G" returned: 0 in 1.112s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:37 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a Apr 30 11:11:37 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:37 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2" returned: 0 in 0.972s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:37 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2 Apr 30 11:11:37 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:38 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:38 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4 Apr 30 11:11:38 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:38 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a" returned: 0 in 0.831s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:38 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a is being set with open permissions: ugo+rw Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:38 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a Apr 30 11:11:38 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:38 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4dabc6c7-1787-4612-95e5-9dda7b054cf2" returned: 0 in 0.787s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-4dabc6c7-1787-4612-95e5-9dda7b054cf2" released by "delete_volume" :: held 1.839s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Created reservations ['81b735ac-bec4-497c-a002-ebe25735b062', '77d9c1c2-e502-46bd-8504-637941cbc985', '86dc66cc-6f53-4f2b-80d8-0bc71f80b83c', '214895bb-1c8b-4be4-b8d7-4d16db0e418c'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:38 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:38 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:39 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a" returned: 0 in 0.793s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-9c3f11ae-a651-4fcb-acab-15d24ceeb096-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:39 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" returned: 0 in 1.025s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-9c3f11ae-a651-4fcb-acab-15d24ceeb096-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-c623f3e1-c6d7-42d7-b99a-cac19a11c6f4" released by "delete_volume" :: held 2.028s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-41c631d5-6f89-4104-b003-8f0735e315e4 tempest-SnapshotsActionsTest-25418463 None] Create snapshot completed successfully Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-quobyte-9c3f11ae-a651-4fcb-acab-15d24ceeb096" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-9c3f11ae-a651-4fcb-acab-15d24ceeb096" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756f85e-dafd-4df9-b596-d4d30a47d35f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Created reservations ['4e871639-f0e6-493e-a4e0-b574f0f2b945'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:39 devstack cinder-volume[84206]: WARNING cinder.quota [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1250179927 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1250179927, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:11:39 devstack cinder-volume[84206]: WARNING cinder.quota [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1250179927 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1250179927, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Created reservations ['819af7e1-4383-4921-99bb-bd780e2416bb', 'e0400e36-3803-478f-9714-95eee8adfca1', '42924498-35ae-425e-8d5f-655fda258dd7', 'f9f6173e-1e56-4270-8811-629f0e5785df'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:39 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 Apr 30 11:11:39 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-09b6387d-0909-49dc-850b-55db90c6f46a-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-09b6387d-0909-49dc-850b-55db90c6f46a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_snapshot" :: waited 0.052s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Acquiring lock "cinder-quobyte-09b6387d-0909-49dc-850b-55db90c6f46a" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-09b6387d-0909-49dc-850b-55db90c6f46a" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Deleting offline snapshot 09b6387d-0909-49dc-850b-55db90c6f46a of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] snapshot_file for this snap is: volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:39 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a7766-8ac6-4b43-b1ef-4d1a65c4eed5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:40 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.118s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:40 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:40 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Deleted volume successfully. Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-54c13d0d-1562-4922-b27f-9ac2725e9967 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-4dabc6c7-1787-4612-95e5-9dda7b054cf2-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:40 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a Apr 30 11:11:40 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:40 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096" returned: 0 in 1.364s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:40 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096 Apr 30 11:11:40 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:40 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.885s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-390d4d44-a1b8-4350-a46d-b2ebdadf3335 tempest-GroupsTest-568995896 None] Delete group completed successfully. Apr 30 11:11:40 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Created reservations ['99be03a3-968a-4b61-bc9f-e3c907b23a1a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:41 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a" returned: 0 in 1.091s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:41 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:41 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef40e24-9350-4b02-8b61-be9310c07c77]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:41 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:41 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:41 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9c3f11ae-a651-4fcb-acab-15d24ceeb096" returned: 0 in 0.804s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-9c3f11ae-a651-4fcb-acab-15d24ceeb096" released by "delete_volume" :: held 2.253s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Created reservations ['67bdb6e2-e7b4-4b96-b883-c38a96d3e87e', '6ae75f0a-58e9-4b3a-b39f-71c6734943ef', '90faac92-4b6c-447b-b70f-709108201903', '91ece20a-f99d-4fc2-afa6-ebf20ed17a1e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:41 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:41 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:41 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-18515d33-1250-4af3-a91b-45ddd500775e tempest-GroupsTest-568995896 None] Delete group completed successfully. Apr 30 11:11:41 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:41 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:42 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.938s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:42 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a Apr 30 11:11:42 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:42 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Deleted volume successfully. Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c3db5f63-9e52-45f0-aec7-bb02823a0ccf tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-9c3f11ae-a651-4fcb-acab-15d24ceeb096-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-cb682b93-e0fa-4d39-87e7-8ebdfe811c77-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-cb682b93-e0fa-4d39-87e7-8ebdfe811c77-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-quobyte-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-136a2cf1-ee36-4134-931d-e91a4653e956 tempest-GroupsTest-568995896 None] Group tempest-GroupsTest-Group-1997715739: creating Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc31b1a-7411-4e33-b6d6-53381b6b0ea8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-136a2cf1-ee36-4134-931d-e91a4653e956 tempest-GroupsTest-568995896 None] Group tempest-GroupsTest-Group-1997715739: created successfully Apr 30 11:11:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-136a2cf1-ee36-4134-931d-e91a4653e956 tempest-GroupsTest-568995896 None] Create group completed successfully. Apr 30 11:11:43 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 Apr 30 11:11:43 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:43 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a" returned: 0 in 1.312s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:43 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a Apr 30 11:11:43 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:43 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" returned: 0 in 0.904s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:43 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77 Apr 30 11:11:43 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (047719c2-6079-49ee-959b-f6f9be14e4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed338e3-fe5e-4006-baa5-870fa332aa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed338e3-fe5e-4006-baa5-870fa332aa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-619591146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bf6d94-b9f4-43d2-8176-a93e5536092c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:44Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8485b287-3146-466d-b379-776f468c864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8485b287-3146-466d-b379-776f468c864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf9a4db-76e6-4019-9675-dce4dcd09840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf9a4db-76e6-4019-9675-dce4dcd09840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bf6d94-b9f4-43d2-8176-a93e5536092c', 'volume_name': 'volume-09bf6d94-b9f4-43d2-8176-a93e5536092c', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2687e6b1-1512-4deb-8745-97a2fbfac8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2687e6b1-1512-4deb-8745-97a2fbfac8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c15465-4147-4252-80df-564f0d9e5d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Volume 09bf6d94-b9f4-43d2-8176-a93e5536092c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bf6d94-b9f4-43d2-8176-a93e5536092c', 'volume_size': 1} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-619591146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bf6d94-b9f4-43d2-8176-a93e5536092c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:44Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Creating volume 09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:44 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.09b6387d-0909-49dc-850b-55db90c6f46a" returned: 0 in 1.097s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:44 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c 1073741824 Apr 30 11:11:44 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-09b6387d-0909-49dc-850b-55db90c6f46a" released by "_delete_snapshot" :: held 4.619s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_snapshot" :: held 4.675s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Created reservations ['a2310ca5-d9f6-4a8b-96b3-f2f2376f636d', 'a47afb89-d9d2-4de3-80d7-6f5c509c5499', '4e247a60-ff5a-40dc-91a0-dc0aef1bceba', '3e7626f5-7c4c-4420-b236-e01d3488872d'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:44 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (664d754c-4b80-47f0-bc40-903a001bbde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06063442-832b-474a-af3e-0afb6afbcc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" returned: 0 in 1.034s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06063442-832b-474a-af3e-0afb6afbcc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97125364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,host='devstack@QuobyteHD#QuobyteHD',id=1c368b69-2667-42b1-8a2a-a18daf69402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:45Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7c6486-1a7b-4116-9fcb-04ed44c815e3),volume_type_id=db7c6486-1a7b-4116-9fcb-04ed44c815e3)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2829bb-f82b-418f-a3d2-2fda2c7779f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2829bb-f82b-418f-a3d2-2fda2c7779f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef39255-56a2-4408-b3c5-6b144fa96ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef39255-56a2-4408-b3c5-6b144fa96ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c368b69-2667-42b1-8a2a-a18daf69402a', 'volume_name': 'volume-1c368b69-2667-42b1-8a2a-a18daf69402a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9343763b-4a53-4746-91a0-9e6a1a2485f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9343763b-4a53-4746-91a0-9e6a1a2485f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3032cd7-c925-4238-ab01-ad43552092a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:44 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Volume 1c368b69-2667-42b1-8a2a-a18daf69402a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c368b69-2667-42b1-8a2a-a18daf69402a', 'volume_size': 1} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-cb682b93-e0fa-4d39-87e7-8ebdfe811c77" released by "delete_volume" :: held 2.052s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:44 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Delete snapshot completed successfully. Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1ed7c3df-d1a3-4b37-91c9-b8d586bf8fb5 tempest-SnapshotsActionsTest-1915263847 None] Lock "cinder-09b6387d-0909-49dc-850b-55db90c6f46a-delete_snapshot" released by "delete_snapshot" :: held 5.102s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Created reservations ['993589dd-4371-4009-919c-a2da5db6cc11', 'e568fd44-d237-462f-8574-b868ca6810a2', '836b1ed6-b7d2-4dbc-b204-02aa1acf8bab', 'cd10acbd-a7d8-4eb2-b142-3e321ffc4aca'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:45 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:45 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-27132986-d74f-4155-82cc-e4460b33538d-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-27132986-d74f-4155-82cc-e4460b33538d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "cinder-quobyte-27132986-d74f-4155-82cc-e4460b33538d" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:45 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-27132986-d74f-4155-82cc-e4460b33538d" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c 1073741824" returned: 0 in 1.063s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a2ed3-c4aa-4d44-9ce3-f2c318370586]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:45 devstack sudo[90813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c Apr 30 11:11:45 devstack sudo[90813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:45 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d Apr 30 11:11:45 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:45 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.739s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Deleted volume successfully. Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c579cd04-6ef9-4242-a6b8-29de382d62f7 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-cb682b93-e0fa-4d39-87e7-8ebdfe811c77-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "cinder-6bb524fb-b038-4129-9f6d-70d844cf63ec-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-6bb524fb-b038-4129-9f6d-70d844cf63ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "cinder-quobyte-6bb524fb-b038-4129-9f6d-70d844cf63ec" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-6bb524fb-b038-4129-9f6d-70d844cf63ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Deleting offline snapshot 6bb524fb-b038-4129-9f6d-70d844cf63ec of volume 174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] snapshot_file for this snap is: volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7195970-dad5-41e6-ab53-2d5ff5394e37]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:46 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:46 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:46 devstack sudo[90813]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c" returned: 0 in 0.796s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.529s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,created_at=2026-04-30T09:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-97125364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,host='devstack@QuobyteHD#QuobyteHD',id=1c368b69-2667-42b1-8a2a-a18daf69402a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:45Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7c6486-1a7b-4116-9fcb-04ed44c815e3),volume_type_id=db7c6486-1a7b-4116-9fcb-04ed44c815e3)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Creating volume 1c368b69-2667-42b1-8a2a-a18daf69402a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:46 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c15465-4147-4252-80df-564f0d9e5d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bf6d94-b9f4-43d2-8176-a93e5536092c', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0096e7-da2b-4c28-9dfe-a881d2156a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:46 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a 1073741824 Apr 30 11:11:46 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:46 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Volume volume-09bf6d94-b9f4-43d2-8176-a93e5536092c (09bf6d94-b9f4-43d2-8176-a93e5536092c): created successfully Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c0096e7-da2b-4c28-9dfe-a881d2156a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (047719c2-6079-49ee-959b-f6f9be14e4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-72f7aab5-5084-4db5-bd49-bd898ec08103 tempest-VolumesSnapshotTestJSON-161216594 None] Created volume successfully. Apr 30 11:11:46 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d" returned: 0 in 1.062s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:46 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d Apr 30 11:11:46 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:47 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.969s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a2cd4-74df-4ef6-a87e-9e4e9b394fab]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:47 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a Apr 30 11:11:47 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:47 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-27132986-d74f-4155-82cc-e4460b33538d" returned: 0 in 0.776s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-quobyte-27132986-d74f-4155-82cc-e4460b33538d" released by "delete_volume" :: held 1.896s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Created reservations ['4602c304-7add-4d3e-a184-642c2ad34170', '8864a821-9c0d-4864-9ffc-69a0f754a617', '272f0503-32f6-45af-b7f8-47e59d4a1371', 'd685b2bd-1d69-49df-994b-95fefc0e9db0'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:47 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a 1073741824" returned: 0 in 1.062s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:47 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a Apr 30 11:11:47 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:47 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:47 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:48 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a" returned: 0 in 0.923s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:48 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:48 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:48 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.715s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Deleted volume successfully. Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d3ceb6bd-0ece-496b-be43-9410ab8c4592 tempest-CreateVolumesFromImageTest-1269609395 None] Lock "cinder-27132986-d74f-4155-82cc-e4460b33538d-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:48 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a" returned: 0 in 0.858s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.302s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3032cd7-c925-4238-ab01-ad43552092a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c368b69-2667-42b1-8a2a-a18daf69402a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04d56ee-0273-4ea4-b1cc-e48e3e155057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Creating offline snapshot d1071660-0495-4553-9447-f2ad62f27f51 of volume 09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:11:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Volume volume-1c368b69-2667-42b1-8a2a-a18daf69402a (1c368b69-2667-42b1-8a2a-a18daf69402a): created successfully Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04d56ee-0273-4ea4-b1cc-e48e3e155057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (664d754c-4b80-47f0-bc40-903a001bbde9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b1945d-bece-4afb-9a6c-7c66ae799e2b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-65be972e-ceed-49fe-a83a-f03d8a43f1d0 tempest-GroupsTest-568995896 None] Created volume successfully. Apr 30 11:11:48 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c Apr 30 11:11:48 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:48 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.930s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:48 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec Apr 30 11:11:48 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:49 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c" returned: 0 in 1.034s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:49 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 1G Apr 30 11:11:49 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:49 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a.6bb524fb-b038-4129-9f6d-70d844cf63ec" returned: 0 in 0.848s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-6bb524fb-b038-4129-9f6d-70d844cf63ec" released by "_delete_snapshot" :: held 3.821s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_snapshot" :: held 3.851s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (bd986094-7bd5-4a3e-870b-131f4b869ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05ebad3-dc2d-4d28-853a-1d6cac021fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b05ebad3-dc2d-4d28-853a-1d6cac021fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432843470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,host='devstack@QuobyteHD#QuobyteHD',id=b74f3f4f-fdce-4c92-a5ea-8d10a1495482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:50Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7c6486-1a7b-4116-9fcb-04ed44c815e3),volume_type_id=db7c6486-1a7b-4116-9fcb-04ed44c815e3)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1d054-d2ad-481f-a450-9c2dee5dcd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c1d054-d2ad-481f-a450-9c2dee5dcd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2e0497-514c-4b77-b144-061c6c32d399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c2e0497-514c-4b77-b144-061c6c32d399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b74f3f4f-fdce-4c92-a5ea-8d10a1495482', 'volume_name': 'volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec18a0-bd01-4d90-b7a2-5db56f04c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cec18a0-bd01-4d90-b7a2-5db56f04c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad20454-cc0a-4bfa-a337-71bc3f8ba985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Volume b74f3f4f-fdce-4c92-a5ea-8d10a1495482: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482', 'volume_size': 1} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Created reservations ['f8388f29-de86-4977-8956-b72662c2973e', '298f9b59-0748-4944-8142-27a537299534', 'c706d1ee-362a-4b8e-ba46-a614d7cc9b87', '808b38c9-7d76-4bfe-85ea-0815a0e3bf01'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Delete snapshot completed successfully. Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ca2f2483-a252-4a34-aafb-90195c631875 tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-6bb524fb-b038-4129-9f6d-70d844cf63ec-delete_snapshot" released by "delete_snapshot" :: held 4.114s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "cinder-174c6ae7-36ca-42a1-9f78-9b19065ad49a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-174c6ae7-36ca-42a1-9f78-9b19065ad49a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b442a288-0bb7-4d69-9236-4f16d9fcaa32]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:50 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 1G" returned: 0 in 1.072s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bf6d94-b9f4-43d2-8176-a93e5536092c -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:50 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bf6d94-b9f4-43d2-8176-a93e5536092c -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 Apr 30 11:11:50 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:50 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a Apr 30 11:11:50 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:51 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09bf6d94-b9f4-43d2-8176-a93e5536092c -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51" returned: 0 in 0.708s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:51 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 is being set with open permissions: ugo+rw Apr 30 11:11:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:51 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a" returned: 0 in 0.808s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:51 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 Apr 30 11:11:51 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:51 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a Apr 30 11:11:51 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:52 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51" returned: 0 in 0.743s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:52 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-174c6ae7-36ca-42a1-9f78-9b19065ad49a" returned: 0 in 0.786s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:52 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info Apr 30 11:11:52 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-quobyte-174c6ae7-36ca-42a1-9f78-9b19065ad49a" released by "delete_volume" :: held 1.672s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Created reservations ['c25bf520-ee9c-4805-9ba4-e60a53429120', '1adf7695-4789-4ceb-af55-c253819a5661', 'b27be791-5dad-4b0e-a13c-4e8253c81df8', '619e3eca-b659-4110-b4b6-a51df548b094'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:52 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:11:52 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:52 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info" returned: 0 in 0.759s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:52 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info is being set with open permissions: ugo+rw Apr 30 11:11:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:52 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info Apr 30 11:11:52 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:53 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.707s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:11:53 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Deleted volume successfully. Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7359b133-ce94-4a71-87b9-77b7be56e19d tempest-SnapshotsActionsTest-25418463 None] Lock "cinder-174c6ae7-36ca-42a1-9f78-9b19065ad49a-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:53 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.info" returned: 0 in 0.723s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.191s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.549s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,created_at=2026-04-30T09:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1432843470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c83289c7-96bc-491f-a17d-0c7d114ff9c1,host='devstack@QuobyteHD#QuobyteHD',id=b74f3f4f-fdce-4c92-a5ea-8d10a1495482,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0e8c2a4b9394e66abd34fb8f09049cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:11:50Z,use_quota=True,user_id='9acb9019e19a455dbdd6447ab9a0dffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db7c6486-1a7b-4116-9fcb-04ed44c815e3),volume_type_id=db7c6486-1a7b-4116-9fcb-04ed44c815e3)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Creating volume b74f3f4f-fdce-4c92-a5ea-8d10a1495482 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:11:53 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:11:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:53 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 1073741824 Apr 30 11:11:53 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:53 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e184925b-b474-4c88-9a8a-7d6530c83ad3 tempest-VolumesSnapshotTestJSON-161216594 None] Create snapshot completed successfully Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-d1071660-0495-4553-9447-f2ad62f27f51-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-d1071660-0495-4553-9447-f2ad62f27f51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:54 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 1073741824" returned: 0 in 1.054s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-d1071660-0495-4553-9447-f2ad62f27f51" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-d1071660-0495-4553-9447-f2ad62f27f51" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:11:54 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Deleting offline snapshot d1071660-0495-4553-9447-f2ad62f27f51 of volume 09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:11:54 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] snapshot_file for this snap is: volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f675aa92-167a-4946-a0aa-44dfb94b59b7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:54 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 Apr 30 11:11:54 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:55 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" returned: 0 in 0.776s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ad20454-cc0a-4bfa-a337-71bc3f8ba985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45c3d1b-e6c1-4518-a368-c9b11dde02ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:11:55 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Volume volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 (b74f3f4f-fdce-4c92-a5ea-8d10a1495482): created successfully Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e45c3d1b-e6c1-4518-a368-c9b11dde02ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Flow 'volume_create_manager' (bd986094-7bd5-4a3e-870b-131f4b869ca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:11:55 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4ef2c4e7-5c68-48b2-bc57-0516ae2b07b0 tempest-GroupsTest-568995896 None] Created volume successfully. Apr 30 11:11:55 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51" returned: 0 in 0.994s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09bf6d94-b9f4-43d2-8176-a93e5536092c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5244cc4-f141-47a6-b423-6f7042b45490]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:11:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:55 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c Apr 30 11:11:55 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:56 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:56 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 Apr 30 11:11:56 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-48926d3b-28ef-4a23-9e6d-146991e2c68b tempest-GroupsTest-568995896 None] Update group completed successfully. Apr 30 11:11:57 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51" returned: 0 in 1.028s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:11:57 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51 Apr 30 11:11:57 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:11:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-66db9e5e-79a4-43a6-907e-e599bbd87713 tempest-GroupsTest-568995896 None] Update group completed successfully. Apr 30 11:11:58 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 30 11:11:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c.d1071660-0495-4553-9447-f2ad62f27f51" returned: 0 in 1.028s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:11:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-d1071660-0495-4553-9447-f2ad62f27f51" released by "_delete_snapshot" :: held 4.162s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" released by "delete_snapshot" :: held 4.200s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:58 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['2401f271-c603-4ba1-8419-598244709841', 'c0e39080-828a-4c1d-98e0-c3a70b911126', '7963d5bc-6595-46d6-b554-97ef79e6580e', '1ff7aa40-6c2e-48fd-9648-f544fabd358c'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:11:59 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Delete snapshot completed successfully. Apr 30 11:11:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f30aea6-d86d-4496-828b-147df22c282a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-d1071660-0495-4553-9447-f2ad62f27f51-delete_snapshot" released by "delete_snapshot" :: held 4.504s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:11:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Acquiring lock "cinder-quobyte-1c368b69-2667-42b1-8a2a-a18daf69402a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:11:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-1c368b69-2667-42b1-8a2a-a18daf69402a" acquired by "delete_volume" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15e38ec-e3d6-4397-b59f-62ab51b4170d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:00 devstack sudo[90931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a Apr 30 11:12:00 devstack sudo[90931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (97560d0f-9b3b-4951-8800-cdf7a1f19551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d4fdc-b1fa-4e03-9640-0f04f544f4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5d4fdc-b1fa-4e03-9640-0f04f544f4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-474899843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d02cf0a-69f9-4b90-84a5-ade71e490df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:01Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65fc0cb-9df8-45d5-9707-b29a0969e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65fc0cb-9df8-45d5-9707-b29a0969e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae3aeb6-cc46-40bb-918a-297d9e56dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae3aeb6-cc46-40bb-918a-297d9e56dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d02cf0a-69f9-4b90-84a5-ade71e490df4', 'volume_name': 'volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67527b86-a6ad-4bd6-a64f-1f0d1a98357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67527b86-a6ad-4bd6-a64f-1f0d1a98357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b63fdd-1d8a-439c-b7b1-c8bf22a7513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:00 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Volume 0d02cf0a-69f9-4b90-84a5-ade71e490df4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4', 'volume_size': 1} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-474899843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d02cf0a-69f9-4b90-84a5-ade71e490df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:01Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Creating volume 0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:00 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:00 devstack sudo[90936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 1073741824 Apr 30 11:12:00 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:00 devstack sudo[90931]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a" returned: 0 in 0.986s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:01 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a Apr 30 11:12:01 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:01 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1c368b69-2667-42b1-8a2a-a18daf69402a" returned: 0 in 0.808s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-1c368b69-2667-42b1-8a2a-a18daf69402a" released by "delete_volume" :: held 1.889s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Acquiring lock "cinder-quobyte-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcf04d4-b726-47dd-9592-9517ba68e09f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:01 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 1073741824" returned: 0 in 1.128s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:02 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:02 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:02 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 Apr 30 11:12:02 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:02 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" returned: 0 in 1.014s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:02 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.959s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] <== create_volume: return (2141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:02 devstack sudo[90953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482 Apr 30 11:12:02 devstack sudo[90953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b63fdd-1d8a-439c-b7b1-c8bf22a7513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06faed3b-eef6-4f29-8ab1-114244a8190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:03 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Volume volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 (0d02cf0a-69f9-4b90-84a5-ade71e490df4): created successfully Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06faed3b-eef6-4f29-8ab1-114244a8190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (97560d0f-9b3b-4951-8800-cdf7a1f19551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cec1a5e8-525b-4501-b4d7-4b81b6352177 tempest-VolumesSnapshotTestJSON-161216594 None] Created volume successfully. Apr 30 11:12:03 devstack sudo[90953]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" returned: 0 in 0.642s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "cinder-quobyte-b74f3f4f-fdce-4c92-a5ea-8d10a1495482" released by "delete_volume" :: held 1.721s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Created reservations ['faa51fac-94c9-4f24-bbb2-2ee6d55ad719'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:03 devstack cinder-volume[84206]: WARNING cinder.quota [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1699027365 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1699027365, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:03 devstack cinder-volume[84206]: WARNING cinder.quota [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1699027365 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1699027365, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Created reservations ['682f0560-ae3c-4bb8-b42c-38f93fa19607', '161bff7b-4a72-421f-a428-4877189f161a', '4036df73-1ea2-4c11-9406-8cb8f7d37a35', '945224b4-770e-4cf3-b270-148d74e94c69'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:03 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Created reservations ['e95ff4af-b5d3-4b7c-813c-e588152fa302', '26e43bb9-a466-494a-953b-0d250a79528a', '034cdff8-fd8f-4771-b804-1ceb8e8c2946', 'e181eaec-3e6f-432c-9c9f-0b6fcaba78a4'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:04 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:04 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Creating offline snapshot 553b7737-7c94-43f7-aeb9-519846918885 of volume 0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd58639-6dc9-434c-920b-e6d1cfe2d505]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:04 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:04 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:04 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.855s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:04 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0a9dbb8a-bead-4295-b5df-dea2b38365cf tempest-GroupsTest-568995896 None] Delete group completed successfully. Apr 30 11:12:05 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 1.086s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:05 devstack sudo[90965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 1G Apr 30 11:12:05 devstack sudo[90965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:06 devstack sudo[90965]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 1G" returned: 0 in 1.117s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:06 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:06 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:07 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:07 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:07 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.985s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:07 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 is being set with open permissions: ugo+rw Apr 30 11:12:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:07 devstack sudo[90978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:07 devstack sudo[90978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:07 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.923s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:08 devstack sudo[90978]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.758s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:08 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info Apr 30 11:12:08 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:09 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info" returned: 0 in 0.800s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:09 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info is being set with open permissions: ugo+rw Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:09 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info Apr 30 11:12:09 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:09 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.info" returned: 0 in 0.800s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.688s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=158,cinder:UPDATE=170,cinder:INSERT=40,cinder:DELETE=11 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:12:09 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=150,cinder:INSERT=48,cinder:UPDATE=184,cinder:DELETE=12 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:12:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c5e17f36-0b8d-40fb-9ee2-cf36f42a5853 tempest-VolumesSnapshotTestJSON-161216594 None] Create snapshot completed successfully Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (48d0394f-7946-4f4e-a4e6-7f30b6a57470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd68abd-660a-4f46-9af6-471ff256fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd68abd-660a-4f46-9af6-471ff256fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1147128504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83465af3-b68a-4f13-904b-7b79b1f5232c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=553b7737-7c94-43f7-aeb9-519846918885,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:11Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0767f37-c5ab-464a-8262-db4b9e730366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0767f37-c5ab-464a-8262-db4b9e730366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cfdfe4-f229-46f3-be54-bc4f14b46c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cfdfe4-f229-46f3-be54-bc4f14b46c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '83465af3-b68a-4f13-904b-7b79b1f5232c', 'volume_name': 'volume-83465af3-b68a-4f13-904b-7b79b1f5232c', 'volume_size': 2, 'snapshot_id': '553b7737-7c94-43f7-aeb9-519846918885'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833fce0c-6793-4711-84ae-fa02999b8f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833fce0c-6793-4711-84ae-fa02999b8f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927ac2ae-f654-4886-82b9-40ef7c1bd624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Volume 83465af3-b68a-4f13-904b-7b79b1f5232c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-83465af3-b68a-4f13-904b-7b79b1f5232c', 'volume_size': 2, 'snapshot_id': '553b7737-7c94-43f7-aeb9-519846918885'} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885-83465af3-b68a-4f13-904b-7b79b1f5232c" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885-83465af3-b68a-4f13-904b-7b79b1f5232c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Creating volume 83465af3-b68a-4f13-904b-7b79b1f5232c from snapshot 553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] snapshot: 553b7737-7c94-43f7-aeb9-519846918885, volume: 83465af3-b68a-4f13-904b-7b79b1f5232c, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eb6e15-bbd8-466f-a00c-b96345a1e865]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:11 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:11 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:12 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.985s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbdd619-50e7-4595-ad27-7caaf30579c7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:12 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:12 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:13 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.883s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:13 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:12:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:13 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c Apr 30 11:12:13 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Flow 'volume_create_manager' (005462cb-5fc6-48ff-b9f8-c1b84492911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70886dc-ff4f-43af-a3a1-3d2ef9077b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70886dc-ff4f-43af-a3a1-3d2ef9077b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-554209069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d52ee7-d1b3-42f6-b106-e5e5ef1865da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b02e91cfe43559001c9494d1f5295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:19Z,use_quota=True,user_id='ee822fd6c2904df68b39665591d62461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342fad07-dfe4-4cd3-9c6f-5da68daeab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342fad07-dfe4-4cd3-9c6f-5da68daeab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef1b9da-ace8-4b1a-a04c-338719e0431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef1b9da-ace8-4b1a-a04c-338719e0431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8d52ee7-d1b3-42f6-b106-e5e5ef1865da', 'volume_name': 'volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a2f50-d918-4cf6-9adc-a9d9b53b2ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3a2f50-d918-4cf6-9adc-a9d9b53b2ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5a5f13-3fe6-4fdb-9448-4c876ec0a601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:19 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Volume a8d52ee7-d1b3-42f6-b106-e5e5ef1865da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da', 'volume_size': 1} Apr 30 11:12:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Flow 'volume_create_manager' (bbbb384e-c14b-4de2-ab5c-29051cae5390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b629cfc-356c-4a03-83a5-cc846ed9ec57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b629cfc-356c-4a03-83a5-cc846ed9ec57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-126408484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c431b6f6-4884-4e24-aa5e-9c1617e1a7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8cd83c053348709bfbcef5a12b77f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:20Z,use_quota=True,user_id='5a95bcba007f4e27878430716d66506c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b5d3dc-fc0f-4e93-82f3-485e3e17afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b5d3dc-fc0f-4e93-82f3-485e3e17afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bfa693-b5fe-4aec-8f11-16de42291c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bfa693-b5fe-4aec-8f11-16de42291c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c431b6f6-4884-4e24-aa5e-9c1617e1a7b3', 'volume_name': 'volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a67869a-823d-4808-8c9b-c16391ea192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a67869a-823d-4808-8c9b-c16391ea192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd3159-6761-4efe-a09b-7439a5c685d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Volume c431b6f6-4884-4e24-aa5e-9c1617e1a7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3', 'volume_size': 1} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:20 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c" returned: 0 in 6.638s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6485ccd0-0787-496f-b970-8480a3f6caaf]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:20 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:20 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:21 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.872s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:12:21 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Converted 1024.00 MB image at 154.23 MB/s Apr 30 11:12:21 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c is being set with open permissions: ugo+rw Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:21 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c Apr 30 11:12:21 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:21 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c" returned: 0 in 0.591s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" released by "_copy_volume_from_snapshot" :: held 10.111s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885-83465af3-b68a-4f13-904b-7b79b1f5232c" released by "_create_volume_from_snapshot" :: held 10.168s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.186s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.589s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-554209069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8d52ee7-d1b3-42f6-b106-e5e5ef1865da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='805b02e91cfe43559001c9494d1f5295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:19Z,use_quota=True,user_id='ee822fd6c2904df68b39665591d62461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Creating volume a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:21 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:21 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da 1073741824 Apr 30 11:12:21 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927ac2ae-f654-4886-82b9-40ef7c1bd624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83465af3-b68a-4f13-904b-7b79b1f5232c', 'volume_size': 2, 'snapshot_id': '553b7737-7c94-43f7-aeb9-519846918885'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb5d935-3f34-4dd3-8f19-fe607be6843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:21 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Volume volume-83465af3-b68a-4f13-904b-7b79b1f5232c (83465af3-b68a-4f13-904b-7b79b1f5232c): created successfully Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb5d935-3f34-4dd3-8f19-fe607be6843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:21 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (48d0394f-7946-4f4e-a4e6-7f30b6a57470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:21 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b2ea04fb-31dc-4733-a164-8a1f87beb63a tempest-VolumesSnapshotTestJSON-161216594 None] Created volume successfully. Apr 30 11:12:22 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da 1073741824" returned: 0 in 0.801s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:22 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da Apr 30 11:12:22 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-83465af3-b68a-4f13-904b-7b79b1f5232c-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-83465af3-b68a-4f13-904b-7b79b1f5232c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce1bc7-f8c2-420b-a7b5-8468641cab90]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:23 devstack sudo[91030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c Apr 30 11:12:23 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:23 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" returned: 0 in 0.712s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.178s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-126408484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c431b6f6-4884-4e24-aa5e-9c1617e1a7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8cd83c053348709bfbcef5a12b77f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:20Z,use_quota=True,user_id='5a95bcba007f4e27878430716d66506c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Creating volume c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:23 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5a5f13-3fe6-4fdb-9448-4c876ec0a601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:23 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 1073741824 Apr 30 11:12:23 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c85fce3-4eda-419c-84b5-c63623658824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:23 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Volume volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da (a8d52ee7-d1b3-42f6-b106-e5e5ef1865da): created successfully Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c85fce3-4eda-419c-84b5-c63623658824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Flow 'volume_create_manager' (005462cb-5fc6-48ff-b9f8-c1b84492911d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:23 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-420a9f63-428d-404c-bf31-db2915bebcd2 tempest-SnapshotMetadataTestJSON-271843018 None] Created volume successfully. Apr 30 11:12:23 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c" returned: 0 in 0.955s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:23 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c Apr 30 11:12:23 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:23 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Flow 'volume_create_manager' (1244c805-04b7-4d8f-b814-f86eb1f374af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e889134e-35d2-4369-8040-c6cc8e9b58aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e889134e-35d2-4369-8040-c6cc8e9b58aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-149462870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f71cc-a027-43ac-943c-74e8ae81ec24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c829a1d3856f46aaa5db5e8c1377760a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:24Z,use_quota=True,user_id='7c6e3eaeeda24806a17931a4f2a35a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0f3da4-aa76-4392-9cd2-e0b816b9640b),volume_type_id=0c0f3da4-aa76-4392-9cd2-e0b816b9640b)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1476b1a1-7a5c-423d-9929-376d2a4621b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1476b1a1-7a5c-423d-9929-376d2a4621b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0e6296-8c64-4853-ade4-c89037cd404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0e6296-8c64-4853-ade4-c89037cd404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04f71cc-a027-43ac-943c-74e8ae81ec24', 'volume_name': 'volume-d04f71cc-a027-43ac-943c-74e8ae81ec24', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ba4f4c-8932-43aa-9867-5edd1feaa443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ba4f4c-8932-43aa-9867-5edd1feaa443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf73912-2dbc-4793-981c-f20633190f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Volume d04f71cc-a027-43ac-943c-74e8ae81ec24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04f71cc-a027-43ac-943c-74e8ae81ec24', 'volume_size': 1} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:24 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 1073741824" returned: 0 in 1.087s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:24 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-83465af3-b68a-4f13-904b-7b79b1f5232c" returned: 0 in 0.687s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-83465af3-b68a-4f13-904b-7b79b1f5232c" released by "delete_volume" :: held 1.710s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:24 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:24 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['ae0819ea-3820-4085-b217-b7f29df52ae1', '2af9436b-c3df-42e8-9fb0-735b99415878', '11f9f244-0d7f-4a10-8570-d1cdec116408', '66ed7cd9-3754-4b55-87d8-3eca670a86d9'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:24 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:24 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-553b7737-7c94-43f7-aeb9-519846918885-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-553b7737-7c94-43f7-aeb9-519846918885-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:25 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Deleting offline snapshot 553b7737-7c94-43f7-aeb9-519846918885 of volume 0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] snapshot_file for this snap is: volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.647s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.170s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-149462870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04f71cc-a027-43ac-943c-74e8ae81ec24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c829a1d3856f46aaa5db5e8c1377760a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:24Z,use_quota=True,user_id='7c6e3eaeeda24806a17931a4f2a35a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0c0f3da4-aa76-4392-9cd2-e0b816b9640b),volume_type_id=0c0f3da4-aa76-4392-9cd2-e0b816b9640b)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Creating volume d04f71cc-a027-43ac-943c-74e8ae81ec24 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:25 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[769821e7-c294-4807-a8a7-b4e2aef9ea84]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:25 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 1073741824 Apr 30 11:12:25 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd3159-6761-4efe-a09b-7439a5c685d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eebfc16-2cb7-4b80-bd5e-3bc44a4f372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:25 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Volume volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 (c431b6f6-4884-4e24-aa5e-9c1617e1a7b3): created successfully Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eebfc16-2cb7-4b80-bd5e-3bc44a4f372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:25 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Flow 'volume_create_manager' (bbbb384e-c14b-4de2-ab5c-29051cae5390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.609s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:25 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Deleted volume successfully. Apr 30 11:12:25 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b8d383b6-1851-4549-a07f-47fea09b8076 tempest-SnapshotDependencyTests-1833001550 None] Created volume successfully. Apr 30 11:12:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-dbb28b83-63ae-4dd6-be1b-2c94eabc67d2 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-83465af3-b68a-4f13-904b-7b79b1f5232c-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:25 devstack sudo[91052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:25 devstack sudo[91052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:26 devstack sudo[91052]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.739s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7d2e2d-f4d4-4ed8-bcac-78703a49763f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:26 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 1073741824" returned: 0 in 0.862s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:26 devstack sudo[91062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:26 devstack sudo[91062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:26 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 Apr 30 11:12:26 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:26 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24" returned: 0 in 0.594s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.185s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf73912-2dbc-4793-981c-f20633190f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04f71cc-a027-43ac-943c-74e8ae81ec24', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd92d284-95cd-4d3f-b0d9-3df840db65bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Creating offline snapshot a63164ef-3c6c-45e3-ac44-13344f9df59e of volume a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:12:26 devstack sudo[91062]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Volume volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 (d04f71cc-a027-43ac-943c-74e8ae81ec24): created successfully Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd92d284-95cd-4d3f-b0d9-3df840db65bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Flow 'volume_create_manager' (1244c805-04b7-4d8f-b814-f86eb1f374af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc74ae7-4c25-4530-bebe-aede7a790629]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.786s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9a02fea0-0199-478e-98ff-31d77352e009 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Created volume successfully. Apr 30 11:12:26 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:26 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:26 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da Apr 30 11:12:26 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:27 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:27 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:27 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" returned: 0 in 0.829s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:27 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.843s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:27 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e 1G Apr 30 11:12:27 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:27 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885 Apr 30 11:12:27 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:28 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.608s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-64a98c7d-9967-4368-8821-167e855e5be5 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Retype volume completed successfully. Apr 30 11:12:28 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4.553b7737-7c94-43f7-aeb9-519846918885" returned: 0 in 0.672s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-553b7737-7c94-43f7-aeb9-519846918885" released by "_delete_snapshot" :: held 3.170s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" released by "delete_snapshot" :: held 3.203s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['faba3cdb-554c-43fd-af08-cbb100dbf68b', '4e7e7f58-cd19-4788-b0a5-1cc66553ffd4', '742a1f45-a0dd-4f8e-a6f4-d79947632ec5', 'bdd779dd-f2de-4100-8e74-ee7a3654d4b5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:28 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e 1G" returned: 0 in 0.839s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:28 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e Apr 30 11:12:28 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Delete snapshot completed successfully. Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-07cf5275-7039-47a5-9ce4-d6334609debf tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-553b7737-7c94-43f7-aeb9-519846918885-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "cinder-d04f71cc-a027-43ac-943c-74e8ae81ec24-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "cinder-d04f71cc-a027-43ac-943c-74e8ae81ec24-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "cinder-quobyte-d04f71cc-a027-43ac-943c-74e8ae81ec24" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "cinder-quobyte-d04f71cc-a027-43ac-943c-74e8ae81ec24" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9c50f-4c11-425b-b36b-9fa398023ccd]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:29 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 Apr 30 11:12:29 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:29 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e" returned: 0 in 0.691s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:29 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e is being set with open permissions: ugo+rw Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:29 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e Apr 30 11:12:29 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-0d02cf0a-69f9-4b90-84a5-ade71e490df4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-0d02cf0a-69f9-4b90-84a5-ade71e490df4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7a801-7bc0-4211-a432-2c77a7fe6c5e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:29 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24" returned: 0 in 0.737s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:29 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:29 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:29 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24 Apr 30 11:12:29 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:29 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e" returned: 0 in 0.671s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:29 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info Apr 30 11:12:29 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:30 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.750s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:30 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4 Apr 30 11:12:30 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:30 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d04f71cc-a027-43ac-943c-74e8ae81ec24" returned: 0 in 0.691s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "cinder-quobyte-d04f71cc-a027-43ac-943c-74e8ae81ec24" released by "delete_volume" :: held 1.490s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:30 devstack cinder-volume[84206]: WARNING cinder.quota [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:30 devstack cinder-volume[84206]: WARNING cinder.quota [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Created reservations ['39bc39e0-9ec8-4929-8f2b-d6b996a8de93', '39bd22de-c57f-4937-99a7-2ef879542c38', 'd03a5346-222c-44c1-b1f8-0ec426081e40', '8e2817ab-023c-4aeb-8c19-ce2fc6f65991'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:30 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info" returned: 0 in 0.663s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:30 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info is being set with open permissions: ugo+rw Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:30 devstack sudo[91119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:30 devstack sudo[91119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:30 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info Apr 30 11:12:30 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:30 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0d02cf0a-69f9-4b90-84a5-ade71e490df4" returned: 0 in 0.622s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-0d02cf0a-69f9-4b90-84a5-ade71e490df4" released by "delete_volume" :: held 1.440s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['1a6cd65f-ea9b-44a8-a28e-9c3a72dab397', 'd15146e8-8cf3-4ab4-9f5d-28b9469c08d9', '2eb7c7ce-ab1f-4a99-96be-7c20f634df2c', '6a3202ed-3643-4933-81dd-50af3e426bc3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:31 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:31 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:31 devstack sudo[91119]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.683s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Deleted volume successfully. Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-83b94431-7595-430c-82b2-a51b371edb19 tempest-VolumeRetypeWithoutMigrationTest-1087073254 None] Lock "cinder-d04f71cc-a027-43ac-943c-74e8ae81ec24-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:31 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.info" returned: 0 in 0.715s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.540s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.655s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Creating offline snapshot 38907ae7-ce8a-4d1b-9a63-55f82e665a2d of volume c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:12:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7336edd5-f2cb-499d-8974-51fce81d7138 tempest-SnapshotMetadataTestJSON-271843018 None] Create snapshot completed successfully Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1ef0be-a8d0-442a-8469-8a5fe4c94b8d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:31 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:31 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:32 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Deleted volume successfully. Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cb9cd012-0777-4074-b1ba-87248d0573b6 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-0d02cf0a-69f9-4b90-84a5-ade71e490df4-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:32 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.941s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:32 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d 1G Apr 30 11:12:32 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (908e84b7-3426-4589-a1fc-cebecd564d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5897660d-35de-4dc8-b3ab-c427e44628fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5897660d-35de-4dc8-b3ab-c427e44628fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-361716568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8600b4f-5538-468f-9293-a9b52e245379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:32Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cb7d25-34e7-4d4e-a2cd-d8b61cbb5229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22cb7d25-34e7-4d4e-a2cd-d8b61cbb5229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5549df2d-708b-43b7-b477-00582bc580cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5549df2d-708b-43b7-b477-00582bc580cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8600b4f-5538-468f-9293-a9b52e245379', 'volume_name': 'volume-c8600b4f-5538-468f-9293-a9b52e245379', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f34c18d-c8bb-4e6a-9638-394bb35853b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f34c18d-c8bb-4e6a-9638-394bb35853b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fa4e21-10c0-4426-88b9-21ee1f759089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Volume c8600b4f-5538-468f-9293-a9b52e245379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8600b4f-5538-468f-9293-a9b52e245379', 'volume_size': 1} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "cinder-a63164ef-3c6c-45e3-ac44-13344f9df59e-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-a63164ef-3c6c-45e3-ac44-13344f9df59e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "cinder-quobyte-a63164ef-3c6c-45e3-ac44-13344f9df59e" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a63164ef-3c6c-45e3-ac44-13344f9df59e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Deleting offline snapshot a63164ef-3c6c-45e3-ac44-13344f9df59e of volume a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] snapshot_file for this snap is: volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb8cbdc-d36a-428f-97b1-f1b7532cd85e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:33 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e Apr 30 11:12:33 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:33 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d 1G" returned: 0 in 0.978s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:33 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:33 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:33 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e" returned: 0 in 0.793s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[948cf745-9527-48c1-940d-f1fcea27559b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:33 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da Apr 30 11:12:33 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:34 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 0.733s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:34 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d is being set with open permissions: ugo+rw Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:34 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:34 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:34 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:34 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e Apr 30 11:12:34 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:34 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 0.741s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:34 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info Apr 30 11:12:34 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:35 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e" returned: 0 in 0.766s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:35 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e Apr 30 11:12:35 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:35 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info" returned: 0 in 0.645s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:35 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info is being set with open permissions: ugo+rw Apr 30 11:12:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:35 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info Apr 30 11:12:35 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:36 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da.a63164ef-3c6c-45e3-ac44-13344f9df59e" returned: 0 in 0.660s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:36 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.info" returned: 0 in 0.622s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.787s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a63164ef-3c6c-45e3-ac44-13344f9df59e" released by "_delete_snapshot" :: held 3.134s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.553s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-361716568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8600b4f-5538-468f-9293-a9b52e245379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:32Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Creating volume c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:36 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" released by "delete_snapshot" :: held 3.192s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:36 devstack sudo[91173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 1073741824 Apr 30 11:12:36 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d8ccd09c-0ae6-49d3-bb99-300cd119e2ff tempest-SnapshotDependencyTests-1833001550 None] Create snapshot completed successfully Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Created reservations ['ce8caa52-d511-445a-800e-0eea532332db', '2a2743f9-c4cd-4233-a8e2-1ec79fb54a3c', '1cf46b2b-8a38-4edf-9f75-3aa562d91580', '33cacfed-81ec-4d84-b522-f5698c8f10cb'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Delete snapshot completed successfully. Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-82adbe89-8d98-4275-85a8-e1c3ce1ca94b tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-a63164ef-3c6c-45e3-ac44-13344f9df59e-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:36 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 1073741824" returned: 0 in 0.865s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:37 devstack sudo[91179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:12:37 devstack sudo[91179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "cinder-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[67068135-c373-4f03-b10e-e838c67ac453]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:37 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da Apr 30 11:12:37 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:37 devstack sudo[91179]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.859s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Flow 'volume_create_manager' (bfd531dc-3cbb-4a5c-aefa-1871e4597ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260aa345-993f-451d-afe3-c79892213f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fa4e21-10c0-4426-88b9-21ee1f759089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8600b4f-5538-468f-9293-a9b52e245379', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072aedd-1ad7-458a-91b8-d671611ff7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260aa345-993f-451d-afe3-c79892213f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9098b6f4-58ee-470a-8a95-0894339dde0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e8cd83c053348709bfbcef5a12b77f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=38907ae7-ce8a-4d1b-9a63-55f82e665a2d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:38Z,use_quota=True,user_id='5a95bcba007f4e27878430716d66506c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695db856-fcd5-42a0-8e3a-f21bffdba230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695db856-fcd5-42a0-8e3a-f21bffdba230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c737ddf3-e8b2-44fe-bec4-bcf0822e3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c737ddf3-e8b2-44fe-bec4-bcf0822e3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9098b6f4-58ee-470a-8a95-0894339dde0a', 'volume_name': 'volume-9098b6f4-58ee-470a-8a95-0894339dde0a', 'volume_size': 1, 'snapshot_id': '38907ae7-ce8a-4d1b-9a63-55f82e665a2d'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc74534f-b55b-4aff-93f0-8cf4e6a02560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc74534f-b55b-4aff-93f0-8cf4e6a02560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ad4426-cce8-4ca2-a4aa-13be23d215a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Volume 9098b6f4-58ee-470a-8a95-0894339dde0a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9098b6f4-58ee-470a-8a95-0894339dde0a', 'volume_size': 1, 'snapshot_id': '38907ae7-ce8a-4d1b-9a63-55f82e665a2d'} Apr 30 11:12:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Volume volume-c8600b4f-5538-468f-9293-a9b52e245379 (c8600b4f-5538-468f-9293-a9b52e245379): created successfully Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5072aedd-1ad7-458a-91b8-d671611ff7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (908e84b7-3426-4589-a1fc-cebecd564d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-9098b6f4-58ee-470a-8a95-0894339dde0a" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Flow 'volume_create_manager' (a91d2287-c41f-45f5-9d36-5951f5ec33ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2342cb-ee6b-4737-9d16-877468462fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2cd33938-adb8-49de-a0cc-c4664d2f7b4b tempest-VolumesSnapshotTestJSON-161216594 None] Created volume successfully. Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-9098b6f4-58ee-470a-8a95-0894339dde0a" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Creating volume 9098b6f4-58ee-470a-8a95-0894339dde0a from snapshot 38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2342cb-ee6b-4737-9d16-877468462fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419940737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9e6e13-0ae6-4e61-95f0-623dbb38035d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91532288898c4db69d8e79b23de05b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:38Z,use_quota=True,user_id='3029f5ce1d9b4b9bb635901a33b54f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c049fdf6-db74-4ab2-b6f8-43cccea9042d),volume_type_id=c049fdf6-db74-4ab2-b6f8-43cccea9042d)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78497ad0-3e7c-47f6-a18e-862d02880559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78497ad0-3e7c-47f6-a18e-862d02880559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7fd0b8-4bb2-4cb5-9f3a-3d6cbea0f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7fd0b8-4bb2-4cb5-9f3a-3d6cbea0f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca9e6e13-0ae6-4e61-95f0-623dbb38035d', 'volume_name': 'volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905d1ee9-abe4-4122-aafb-b4c50ea9d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905d1ee9-abe4-4122-aafb-b4c50ea9d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf7aeab-ee05-442a-8e66-5a3da390e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Volume ca9e6e13-0ae6-4e61-95f0-623dbb38035d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d', 'volume_size': 1} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" acquired by "_copy_volume_from_snapshot" :: waited 0.057s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] snapshot: 38907ae7-ce8a-4d1b-9a63-55f82e665a2d, volume: 9098b6f4-58ee-470a-8a95-0894339dde0a, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b98f83-d6a8-4a14-8033-edc97da3e5a0]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:38 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" returned: 0 in 0.898s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:38 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da Apr 30 11:12:38 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:38 devstack sudo[91187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:38 devstack sudo[91187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:38 devstack sudo[91187]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 0.738s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:12:38 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3dc42-2985-41a0-9ae3-00723bf4817b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" returned: 0 in 0.699s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-quobyte-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da" released by "delete_volume" :: held 1.701s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Created reservations ['58656dd7-c906-46ae-ab2f-967cab66b878', 'f96fb0f2-6f85-4381-836c-74fe8c88f1ed', '26435dd8-624f-4b64-b319-0d1cbc2b170f', '4ec9b566-8e83-43b3-827a-91fc9e061c59'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:39 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:39 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:39 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:39 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:39 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.807s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:39 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.640s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Deleted volume successfully. Apr 30 11:12:39 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a Apr 30 11:12:39 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce1a3d1d-55cc-483a-b143-aa39998cb0ab tempest-SnapshotMetadataTestJSON-271843018 None] Lock "cinder-a8d52ee7-d1b3-42f6-b106-e5e5ef1865da-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:45 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a" returned: 0 in 5.688s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df435a0-8f96-4ed2-8785-191bcb05138e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:45 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:45 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:46 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.909s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:46 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:12:46 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Converted 1024.00 MB image at 180.02 MB/s Apr 30 11:12:46 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a is being set with open permissions: ugo+rw Apr 30 11:12:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:46 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a Apr 30 11:12:46 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:46 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a" returned: 0 in 0.570s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" released by "_copy_volume_from_snapshot" :: held 8.832s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-9098b6f4-58ee-470a-8a95-0894339dde0a" released by "_create_volume_from_snapshot" :: held 8.903s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.953s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.853s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-419940737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9e6e13-0ae6-4e61-95f0-623dbb38035d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91532288898c4db69d8e79b23de05b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:38Z,use_quota=True,user_id='3029f5ce1d9b4b9bb635901a33b54f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c049fdf6-db74-4ab2-b6f8-43cccea9042d),volume_type_id=c049fdf6-db74-4ab2-b6f8-43cccea9042d)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Creating volume ca9e6e13-0ae6-4e61-95f0-623dbb38035d {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:47 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:47 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d 1073741824 Apr 30 11:12:47 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ad4426-cce8-4ca2-a4aa-13be23d215a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9098b6f4-58ee-470a-8a95-0894339dde0a', 'volume_size': 1, 'snapshot_id': '38907ae7-ce8a-4d1b-9a63-55f82e665a2d'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78cb9fc-448e-4b3f-8782-cb4c296ba049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:47 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Volume volume-9098b6f4-58ee-470a-8a95-0894339dde0a (9098b6f4-58ee-470a-8a95-0894339dde0a): created successfully Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78cb9fc-448e-4b3f-8782-cb4c296ba049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Flow 'volume_create_manager' (bfd531dc-3cbb-4a5c-aefa-1871e4597ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c83a7e22-ed1f-4038-85c7-1380b341f33b tempest-SnapshotDependencyTests-1833001550 None] Created volume successfully. Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Deleting offline snapshot 38907ae7-ce8a-4d1b-9a63-55f82e665a2d of volume c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:12:47 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] snapshot_file for this snap is: volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d 1073741824" returned: 0 in 0.898s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[095adf54-3eb9-48e4-a06a-84fc8cfb0810]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:47 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d Apr 30 11:12:47 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:48 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:48 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:48 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" returned: 0 in 0.685s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.591s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:48 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 0.779s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Creating offline snapshot b18ab173-b74d-4cbd-be92-38cf16cb1172 of volume c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a4b01-78ef-4768-9d29-1e3c8e610e57]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecf7aeab-ee05-442a-8e66-5a3da390e968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e566ae5a-309c-4a13-afd5-0b88377bad2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[52956a3b-c226-47db-aa97-c1b8a7920e0a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Volume volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d (ca9e6e13-0ae6-4e61-95f0-623dbb38035d): created successfully Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e566ae5a-309c-4a13-afd5-0b88377bad2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Flow 'volume_create_manager' (a91d2287-c41f-45f5-9d36-5951f5ec33ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c93f56af-8f92-43fa-bf97-8da2f74dd98f tempest-VolumeTypesAccessTest-1115869986 None] Created volume successfully. Apr 30 11:12:48 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:48 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:48 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:12:48 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:49 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.788s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:49 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.756s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:49 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:49 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:49 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 1G Apr 30 11:12:49 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Acquiring lock "cinder-ca9e6e13-0ae6-4e61-95f0-623dbb38035d-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "cinder-ca9e6e13-0ae6-4e61-95f0-623dbb38035d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Acquiring lock "cinder-quobyte-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "cinder-quobyte-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" acquired by "delete_volume" :: waited 0.049s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb17d9f-cc17-437f-8f3f-67a7a3917ef7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:50 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d Apr 30 11:12:50 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:50 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 1.005s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:50 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:50 devstack sudo[91300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 1G" returned: 0 in 1.032s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8600b4f-5538-468f-9293-a9b52e245379 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:50 devstack sudo[91300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:50 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8600b4f-5538-468f-9293-a9b52e245379 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:12:50 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:51 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" returned: 0 in 0.969s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:51 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d Apr 30 11:12:51 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:51 devstack sudo[91300]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3.38907ae7-ce8a-4d1b-9a63-55f82e665a2d" returned: 0 in 0.839s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-38907ae7-ce8a-4d1b-9a63-55f82e665a2d" released by "_delete_snapshot" :: held 3.552s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" released by "delete_snapshot" :: held 3.578s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:51 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8600b4f-5538-468f-9293-a9b52e245379 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 0.895s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:51 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 is being set with open permissions: ugo+rw Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:51 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:12:51 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Created reservations ['aec4406c-1db4-4d6e-99f5-9e349f72a39d', '648916b4-4f37-4ddf-8b63-85c8092cbaf3', '53c888d4-9e5e-43e8-b8d5-efa238bf5fb6', 'c640f21a-04bc-4355-86ec-dc0ff5d55218'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Delete snapshot completed successfully. Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bd0b5155-ba34-4a0f-a8c2-4fb6a2e6fc41 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-38907ae7-ce8a-4d1b-9a63-55f82e665a2d-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:51 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" returned: 0 in 0.673s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "cinder-quobyte-ca9e6e13-0ae6-4e61-95f0-623dbb38035d" released by "delete_volume" :: held 1.704s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:51 devstack cinder-volume[84206]: WARNING cinder.quota [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1821727222 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1821727222, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:51 devstack cinder-volume[84206]: WARNING cinder.quota [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1821727222 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1821727222, it is now deprecated. Please use the default quota class for default quota. Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Created reservations ['fb6e6d7e-5c03-41ca-a979-7c1a35e7bfcb', 'b3474b02-8760-44f4-b014-bafd024e0609', 'b087cd9b-0b57-48ed-ae90-09c01aeb5d54', '46d3288d-cf01-49e6-b49e-e5bb4026dc98'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:52 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:52 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:52 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 0.816s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d567de89-c1b2-4144-9755-972d215573c2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:52 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info Apr 30 11:12:52 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:52 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:52 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:53 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.197s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:53 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Deleted volume successfully. Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-55acfe36-1994-4ff6-b95f-890eba1b9a07 tempest-VolumeTypesAccessTest-1115869986 None] Lock "cinder-ca9e6e13-0ae6-4e61-95f0-623dbb38035d-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:53 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info" returned: 0 in 1.036s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:53 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info is being set with open permissions: ugo+rw Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:53 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info Apr 30 11:12:53 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:53 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 1.165s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:53 devstack sudo[91331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3 Apr 30 11:12:53 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:54 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.info" returned: 0 in 0.790s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.579s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cc45209f-daee-46c5-af21-a909f33b0039 tempest-VolumesSnapshotTestJSON-161216594 None] Create snapshot completed successfully Apr 30 11:12:54 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" returned: 0 in 0.840s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3" released by "delete_volume" :: held 2.114s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Created reservations ['1e255b34-bdfe-4b29-aca0-b6e61278a919', '929b1bb5-5aba-4a2c-9c9a-f29eb0aa9f54', '2c3f07e9-f356-4122-989c-4640220312c4', '7490f653-b2dd-4826-97de-3af85c402ce5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:54 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:54 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:55 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.770s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:55 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Deleted volume successfully. Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-09ca6be9-ed63-45ae-8b69-a7dbd8db3095 tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-c431b6f6-4884-4e24-aa5e-9c1617e1a7b3-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-9098b6f4-58ee-470a-8a95-0894339dde0a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-9098b6f4-58ee-470a-8a95-0894339dde0a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b31d22d-bce0-4281-954e-04305b5d868c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (215e4da4-dfe9-4689-b18f-007690527f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa9a19c-cb5d-47f3-b7a4-ac4a2ff30cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa9a19c-cb5d-47f3-b7a4-ac4a2ff30cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1987161642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3efcba96-bc4b-446e-b790-f085bdb52cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96b15b596ff9464b965bd8453e97f29a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b18ab173-b74d-4cbd-be92-38cf16cb1172,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:56Z,use_quota=True,user_id='b126f81f046a476b8569d673b60a16fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd972501-99bb-4211-92b9-f144b72b6753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd972501-99bb-4211-92b9-f144b72b6753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007fe8d1-aecc-4c7f-9eac-edfe4e74394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007fe8d1-aecc-4c7f-9eac-edfe4e74394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3efcba96-bc4b-446e-b790-f085bdb52cfd', 'volume_name': 'volume-3efcba96-bc4b-446e-b790-f085bdb52cfd', 'volume_size': 1, 'snapshot_id': 'b18ab173-b74d-4cbd-be92-38cf16cb1172'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f72e3a-6004-4eec-992b-095f9fc7b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6f72e3a-6004-4eec-992b-095f9fc7b586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:55 devstack sudo[91347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a Apr 30 11:12:55 devstack sudo[91347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e977dfb-11e0-4e0c-9b09-987b775d5e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:55 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Volume 3efcba96-bc4b-446e-b790-f085bdb52cfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3efcba96-bc4b-446e-b790-f085bdb52cfd', 'volume_size': 1, 'snapshot_id': 'b18ab173-b74d-4cbd-be92-38cf16cb1172'} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172-3efcba96-bc4b-446e-b790-f085bdb52cfd" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172-3efcba96-bc4b-446e-b790-f085bdb52cfd" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Creating volume 3efcba96-bc4b-446e-b790-f085bdb52cfd from snapshot b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] snapshot: b18ab173-b74d-4cbd-be92-38cf16cb1172, volume: 3efcba96-bc4b-446e-b790-f085bdb52cfd, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dbe548-34a8-42e6-b5d9-0a02e8892a63]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:56 devstack sudo[91349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:12:56 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:56 devstack sudo[91347]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a" returned: 0 in 0.986s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:56 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a Apr 30 11:12:56 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:57 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 1.198s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8600b4f-5538-468f-9293-a9b52e245379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3e76e-8c95-463e-9b15-f939e5df5027]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:57 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:12:57 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:57 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9098b6f4-58ee-470a-8a95-0894339dde0a" returned: 0 in 0.939s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-quobyte-9098b6f4-58ee-470a-8a95-0894339dde0a" released by "delete_volume" :: held 2.023s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Created reservations ['b74be76b-37bc-44b3-8afc-e2fbdaa1367c', '21b665a9-f610-4e93-881a-497b911ff0ca', '0e2724c1-a184-49f9-a466-b13d2e03e293', '0131fefc-6e2e-459b-8eb8-e583c3083ae0'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:12:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:57 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:12:57 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:58 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:12:58 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd Apr 30 11:12:58 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Flow 'volume_create_manager' (ec0435f8-7fea-432d-8660-c20fc75c29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d279d-70bf-429e-be27-61f0cd49a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:58 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.996s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6d279d-70bf-429e-be27-61f0cd49a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24624177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7484b8-8763-4626-a374-c5343a93a926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d565cd4d3744575ac1e75c1c71dc41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:59Z,use_quota=True,user_id='6628cd13b8254540b57c3846c73dd690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4a8f84-aaff-4d40-aaa3-aeef8b090215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4a8f84-aaff-4d40-aaa3-aeef8b090215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4412c0f1-76c2-415b-9e15-2db3d89532b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4412c0f1-76c2-415b-9e15-2db3d89532b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7484b8-8763-4626-a374-c5343a93a926', 'volume_name': 'volume-5f7484b8-8763-4626-a374-c5343a93a926', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d484ba-a4d6-41c2-ac06-d510c9cd89d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d484ba-a4d6-41c2-ac06-d510c9cd89d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30790f4-79f6-4b8a-baca-8b7054efb4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:12:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Volume 5f7484b8-8763-4626-a374-c5343a93a926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7484b8-8763-4626-a374-c5343a93a926', 'volume_size': 1} Apr 30 11:12:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:12:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Deleted volume successfully. Apr 30 11:12:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-096f3b02-d357-4bfa-9fef-35d544f2907f tempest-SnapshotDependencyTests-1833001550 None] Lock "cinder-9098b6f4-58ee-470a-8a95-0894339dde0a-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:04 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd" returned: 0 in 6.358s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:04 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01a8b98-a64c-4f1c-880f-8645dfc610e8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:04 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:13:04 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:05 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 1.031s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:05 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:13:05 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Converted 1024.00 MB image at 161.03 MB/s Apr 30 11:13:05 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd is being set with open permissions: ugo+rw Apr 30 11:13:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:05 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd Apr 30 11:13:05 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:06 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd" returned: 0 in 0.764s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" released by "_copy_volume_from_snapshot" :: held 10.438s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172-3efcba96-bc4b-446e-b790-f085bdb52cfd" released by "_create_volume_from_snapshot" :: held 10.493s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.514s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.517s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-24624177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7484b8-8763-4626-a374-c5343a93a926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d565cd4d3744575ac1e75c1c71dc41f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:12:59Z,use_quota=True,user_id='6628cd13b8254540b57c3846c73dd690',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Creating volume 5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:06 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:06 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 1073741824 Apr 30 11:13:06 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e977dfb-11e0-4e0c-9b09-987b775d5e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3efcba96-bc4b-446e-b790-f085bdb52cfd', 'volume_size': 1, 'snapshot_id': 'b18ab173-b74d-4cbd-be92-38cf16cb1172'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864da6a6-8f6c-4129-ac51-d919dd83c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:06 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Volume volume-3efcba96-bc4b-446e-b790-f085bdb52cfd (3efcba96-bc4b-446e-b790-f085bdb52cfd): created successfully Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864da6a6-8f6c-4129-ac51-d919dd83c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Flow 'volume_create_manager' (215e4da4-dfe9-4689-b18f-007690527f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:06 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-5bdaa235-23a6-4007-bc0f-199afe016133 tempest-VolumesSnapshotTestJSON-161216594 None] Created volume successfully. Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:07 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:07 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-3efcba96-bc4b-446e-b790-f085bdb52cfd-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-3efcba96-bc4b-446e-b790-f085bdb52cfd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[11814e5b-1541-4d1d-8bd0-cc96f92fc210]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:07 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd Apr 30 11:13:07 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:07 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 1073741824" returned: 0 in 1.316s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:07 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:13:07 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:08 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.063s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:08 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd" returned: 0 in 1.039s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:08 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd Apr 30 11:13:08 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:08 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.847s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e30790f4-79f6-4b8a-baca-8b7054efb4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7484b8-8763-4626-a374-c5343a93a926', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144009ad-ed84-4f82-8399-d059a892fd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:08 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Volume volume-5f7484b8-8763-4626-a374-c5343a93a926 (5f7484b8-8763-4626-a374-c5343a93a926): created successfully Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144009ad-ed84-4f82-8399-d059a892fd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Flow 'volume_create_manager' (ec0435f8-7fea-432d-8660-c20fc75c29fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:08 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-58fb0a96-715a-4fed-993c-7de26e2b5565 tempest-VolumesActionsTest-652539150 None] Created volume successfully. Apr 30 11:13:09 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3efcba96-bc4b-446e-b790-f085bdb52cfd" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-3efcba96-bc4b-446e-b790-f085bdb52cfd" released by "delete_volume" :: held 1.902s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['80c188a6-8b7c-443b-8368-132e0eb027f6', 'aa73852c-3134-4da0-964e-28acec9290eb', '8f841368-1020-4e5d-ae56-24ea997a74ec', '94884ab3-e365-41fc-b9ac-00366873b3f0'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-b18ab173-b74d-4cbd-be92-38cf16cb1172-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:09 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:09 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-b18ab173-b74d-4cbd-be92-38cf16cb1172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Deleting offline snapshot b18ab173-b74d-4cbd-be92-38cf16cb1172 of volume c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] snapshot_file for this snap is: volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[984ad06f-1c70-4b57-9769-13e29241679d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:09 devstack sudo[91416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:13:09 devstack sudo[91416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:10 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.002s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Deleted volume successfully. Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:DELETE=12,cinder:UPDATE=110,cinder:SELECT=97,cinder:INSERT=25 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8f3cef08-fb8c-4b17-b64b-3b0aba03804c tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-3efcba96-bc4b-446e-b790-f085bdb52cfd-delete_volume" released by "delete_volume" :: held 3.367s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:10 devstack sudo[91416]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 1.082s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8600b4f-5538-468f-9293-a9b52e245379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2753f72d-9eda-42d8-b825-482a91f5494f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:11 devstack sudo[91425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:13:11 devstack sudo[91425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:11 devstack sudo[91425]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.946s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:11 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:13:11 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:12 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 0.816s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:12 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172 Apr 30 11:13:12 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:13 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379.b18ab173-b74d-4cbd-be92-38cf16cb1172" returned: 0 in 0.639s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=91,cinder:UPDATE=117,cinder:INSERT=28,cinder:DELETE=9 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-b18ab173-b74d-4cbd-be92-38cf16cb1172" released by "_delete_snapshot" :: held 3.667s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" released by "delete_snapshot" :: held 3.714s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['62d23706-7351-47fa-b7d4-65d22b0c4fdc', '91e10397-d281-47a5-ae80-3065a2c055ec', 'f392d2cf-12eb-41a7-be55-7e2eb616931c', 'd9b109f0-0fed-48da-90bd-4e8246968915'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Delete snapshot completed successfully. Apr 30 11:13:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ce8839fe-587f-4dd5-94a8-4667fbf6b7c3 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-b18ab173-b74d-4cbd-be92-38cf16cb1172-delete_snapshot" released by "delete_snapshot" :: held 3.900s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-c8600b4f-5538-468f-9293-a9b52e245379-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-c8600b4f-5538-468f-9293-a9b52e245379-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3128d70-b7f7-457c-a206-afcf30a3d1da]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:14 devstack sudo[91442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:13:14 devstack sudo[91442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:14 devstack sudo[91442]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.750s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:14 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379 Apr 30 11:13:14 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:15 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c8600b4f-5538-468f-9293-a9b52e245379" returned: 0 in 0.676s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-c8600b4f-5538-468f-9293-a9b52e245379" released by "delete_volume" :: held 1.506s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['4bb236e2-bb21-4c4f-ba3c-36e6f19d4374', '9254ce69-1a05-4f69-9bd8-3f3c16ef4d4a', '50d908e7-b174-4fdb-a58d-050e75100fe5', '4a240a01-0e35-46bf-a288-f1e53567b0d6'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:15 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:15 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-09bf6d94-b9f4-43d2-8176-a93e5536092c-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-09bf6d94-b9f4-43d2-8176-a93e5536092c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:16 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.813s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:16 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Deleted volume successfully. Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" acquired by "delete_volume" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67604aba-c722-453d-9241-571587abec0d tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-c8600b4f-5538-468f-9293-a9b52e245379-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17209af-49ba-4b81-985b-d995c4edcdeb]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:16 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c Apr 30 11:13:16 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:17 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c" returned: 0 in 0.844s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:17 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c Apr 30 11:13:17 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:18 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09bf6d94-b9f4-43d2-8176-a93e5536092c" returned: 0 in 0.681s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-quobyte-09bf6d94-b9f4-43d2-8176-a93e5536092c" released by "delete_volume" :: held 1.614s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Created reservations ['0e810302-b690-45d1-a13e-921edabe58b7', 'ffb8defc-b28e-4ebb-b248-cfbf5bbb3111', '77fa6b02-fe60-43d1-b667-c513ef23c1d9', '0c0c8a29-d4e3-4e27-81a2-e97180300fb1'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:18 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:18 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:19 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.599s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:19 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:19 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Deleted volume successfully. Apr 30 11:13:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ef1f2a8-6d45-4dcc-a3ed-ad38f64f7636 tempest-VolumesSnapshotTestJSON-161216594 None] Lock "cinder-09bf6d94-b9f4-43d2-8176-a93e5536092c-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Flow 'volume_create_manager' (9f64fdc8-cb8b-430d-860d-231dd2200c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeb3e7d-ba67-48f0-834b-55db259b8efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eeb3e7d-ba67-48f0-834b-55db259b8efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1426041029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820533ff-0c06-4c6d-bdf0-0e6327965c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01168c0231c64a2ea5ec73c8df35b787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='cd5c0ec2a2344c1f96cec40a2fbe6636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff01844-c296-41f8-8e8e-33461389d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff01844-c296-41f8-8e8e-33461389d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6433b97c-8acc-437d-bc07-7ffb80b3dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6433b97c-8acc-437d-bc07-7ffb80b3dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820533ff-0c06-4c6d-bdf0-0e6327965c5a', 'volume_name': 'volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc65056-f6a3-4fcf-ba16-acbc256b2c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc65056-f6a3-4fcf-ba16-acbc256b2c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5773e8a4-f0e1-4aec-87e0-8f0003e6c57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Volume 820533ff-0c06-4c6d-bdf0-0e6327965c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a', 'volume_size': 1} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1426041029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820533ff-0c06-4c6d-bdf0-0e6327965c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01168c0231c64a2ea5ec73c8df35b787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:21Z,use_quota=True,user_id='cd5c0ec2a2344c1f96cec40a2fbe6636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Creating volume 820533ff-0c06-4c6d-bdf0-0e6327965c5a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:20 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:20 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a 1073741824 Apr 30 11:13:20 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:21 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a 1073741824" returned: 0 in 0.898s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:21 devstack sudo[91492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a Apr 30 11:13:21 devstack sudo[91492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:22 devstack sudo[91492]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a" returned: 0 in 0.655s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5773e8a4-f0e1-4aec-87e0-8f0003e6c57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec222c4-12f0-4b7f-82be-9929b4bbf040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:22 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Volume volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a (820533ff-0c06-4c6d-bdf0-0e6327965c5a): created successfully Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec222c4-12f0-4b7f-82be-9929b4bbf040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:22 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Flow 'volume_create_manager' (9f64fdc8-cb8b-430d-860d-231dd2200c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-fedde400-49a2-4a88-a1e5-4415851edb78 tempest-AbsoluteLimitsTests-692748116 None] Created volume successfully. Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Acquiring lock "cinder-820533ff-0c06-4c6d-bdf0-0e6327965c5a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "cinder-820533ff-0c06-4c6d-bdf0-0e6327965c5a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Acquiring lock "cinder-quobyte-820533ff-0c06-4c6d-bdf0-0e6327965c5a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "cinder-quobyte-820533ff-0c06-4c6d-bdf0-0e6327965c5a" acquired by "delete_volume" :: waited 0.038s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1a2e73-481e-4f59-b17b-952efd66fd86]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:23 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a Apr 30 11:13:23 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:24 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a" returned: 0 in 1.019s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:24 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a Apr 30 11:13:24 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:25 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-820533ff-0c06-4c6d-bdf0-0e6327965c5a" returned: 0 in 0.947s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "cinder-quobyte-820533ff-0c06-4c6d-bdf0-0e6327965c5a" released by "delete_volume" :: held 2.043s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Created reservations ['585fbaee-9aa3-4ed3-8ffd-ece9cfe2a6b9', 'ae61e8b4-6011-4d37-bcbf-4d4f17d08dd6', '7e928f27-16a5-415e-9bad-02775a55d679', '79cff7a1-1d90-4c72-8cf2-50173846b6df'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:25 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:25 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (6facc38f-50dd-469e-9bde-87a2052bc9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b57d0-8bd8-45ce-b9ab-01c09761d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670b57d0-8bd8-45ce-b9ab-01c09761d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7185372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fbef74-5bc5-4852-bc2f-5b28f198b4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:26Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37652b20-bf7d-4a8f-96c0-702e120ba531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37652b20-bf7d-4a8f-96c0-702e120ba531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e7b6c-0d55-4fc7-80ce-0db9548323a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:25 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (939e7b6c-0d55-4fc7-80ce-0db9548323a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fbef74-5bc5-4852-bc2f-5b28f198b4c6', 'volume_name': 'volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc7c8be-1673-4313-82c8-98051df02df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc7c8be-1673-4313-82c8-98051df02df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b8eec9-9296-408f-acb9-c17bac09ea2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:26 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume 36fbef74-5bc5-4852-bc2f-5b28f198b4c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6', 'volume_size': 1} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-7185372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fbef74-5bc5-4852-bc2f-5b28f198b4c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:26Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume 36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:26 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:26 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 1073741824 Apr 30 11:13:26 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:26 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.772s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Deleted volume successfully. Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f6da8eda-ede8-44bb-98d6-fc9be15d1951 tempest-AbsoluteLimitsTests-692748116 None] Lock "cinder-820533ff-0c06-4c6d-bdf0-0e6327965c5a-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf2da2ce-de13-40ba-8637-b350a4290f5b tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" by "attach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf2da2ce-de13-40ba-8637-b350a4290f5b tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" acquired by "attach_volume" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bf2da2ce-de13-40ba-8637-b350a4290f5b tempest-VolumesActionsTest-652539150 None] Attaching volume 5f7484b8-8763-4626-a374-c5343a93a926 to instance 73b79cc4-2c75-4e12-96fc-6c983eeb671e at mountpoint /dev/vdb on host None. Apr 30 11:13:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bf2da2ce-de13-40ba-8637-b350a4290f5b tempest-VolumesActionsTest-652539150 None] Attach volume completed successfully. Apr 30 11:13:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bf2da2ce-de13-40ba-8637-b350a4290f5b tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" released by "attach_volume" :: held 0.127s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:27 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 1073741824" returned: 0 in 1.094s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:27 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 Apr 30 11:13:27 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6b6a6ae-357f-4a43-966c-65e6b84f8227 tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" by "detach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6b6a6ae-357f-4a43-966c-65e6b84f8227 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e6b6a6ae-357f-4a43-966c-65e6b84f8227 tempest-VolumesActionsTest-652539150 None] Detaching volume 5f7484b8-8763-4626-a374-c5343a93a926 from instance 73b79cc4-2c75-4e12-96fc-6c983eeb671e. Apr 30 11:13:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e6b6a6ae-357f-4a43-966c-65e6b84f8227 tempest-VolumesActionsTest-652539150 None] Detach volume completed successfully. Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6b6a6ae-357f-4a43-966c-65e6b84f8227 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" released by "detach_volume" :: held 0.093s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:27 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" returned: 0 in 0.764s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b8eec9-9296-408f-acb9-c17bac09ea2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60b34ea-4716-4f11-bccc-0f37b7ad647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 (36fbef74-5bc5-4852-bc2f-5b28f198b4c6): created successfully Apr 30 11:13:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f60b34ea-4716-4f11-bccc-0f37b7ad647b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:28 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (6facc38f-50dd-469e-9bde-87a2052bc9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-44ebc12d-c724-41be-950c-7267b40a95b0 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating offline snapshot c1eecfb0-e759-43be-8b96-c70292e9328c of volume 36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:13:29 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9178fb9-8e98-424a-b9b6-455d8acd1603]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:29 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 Apr 30 11:13:29 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:30 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" returned: 0 in 0.842s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:30 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c 1G Apr 30 11:13:30 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:31 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c 1G" returned: 0 in 0.890s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:31 devstack sudo[91637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c Apr 30 11:13:31 devstack sudo[91637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:32 devstack sudo[91637]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c" returned: 0 in 0.728s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:32 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c is being set with open permissions: ugo+rw Apr 30 11:13:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:32 devstack sudo[91642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c Apr 30 11:13:32 devstack sudo[91642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:32 devstack sudo[91642]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c" returned: 0 in 0.632s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:32 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info Apr 30 11:13:32 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Flow 'volume_create_manager' (f5f86c36-16a2-4e8c-ad6e-1497e647e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd820fc-1e06-4c63-9fe4-f4644dad29ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:33 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info" returned: 0 in 0.639s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:33 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info is being set with open permissions: ugo+rw Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd820fc-1e06-4c63-9fe4-f4644dad29ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1871978377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd07d383-7a34-4c92-94d4-3746b373bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7b02167894380a21ff6d7f1cdcc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:33Z,use_quota=True,user_id='84951b94bff2447c934091fe0461560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:33 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info Apr 30 11:13:33 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8382fca-83e1-4e71-bfee-382bc0d42a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8382fca-83e1-4e71-bfee-382bc0d42a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d1d61d-26bd-4c14-bf7c-e06b1f1365e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2d1d61d-26bd-4c14-bf7c-e06b1f1365e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd07d383-7a34-4c92-94d4-3746b373bcab', 'volume_name': 'volume-dd07d383-7a34-4c92-94d4-3746b373bcab', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856e9314-7c89-4f70-8cd6-585ea702eece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856e9314-7c89-4f70-8cd6-585ea702eece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781f50d2-2b12-4e30-95e9-d7b360f52a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Volume dd07d383-7a34-4c92-94d4-3746b373bcab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd07d383-7a34-4c92-94d4-3746b373bcab', 'volume_size': 1} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:33 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.info" returned: 0 in 0.613s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1871978377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd07d383-7a34-4c92-94d4-3746b373bcab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7b02167894380a21ff6d7f1cdcc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:33Z,use_quota=True,user_id='84951b94bff2447c934091fe0461560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Creating volume dd07d383-7a34-4c92-94d4-3746b373bcab {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:33 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:34 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab 1073741824 Apr 30 11:13:34 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4bc8037d-0388-4685-a320-7098a282539e tempest-CreateVolumesFromSnapshotTest-869720420 None] Create snapshot completed successfully Apr 30 11:13:34 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab 1073741824" returned: 0 in 0.836s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:34 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab Apr 30 11:13:34 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (ae6c4f1a-d181-4e71-8ea4-f928a9d3f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d455c3-05ed-4dae-9f86-8094c469db59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d455c3-05ed-4dae-9f86-8094c469db59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3056389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7ad47b-9fea-4b6b-ba20-2a2146912280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:35Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31866caf-0d98-4307-b456-4d56692cce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31866caf-0d98-4307-b456-4d56692cce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4373c5ba-d56e-4da9-81a6-e2cb9779d216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4373c5ba-d56e-4da9-81a6-e2cb9779d216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7ad47b-9fea-4b6b-ba20-2a2146912280', 'volume_name': 'volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e99fe12-1af5-4d80-a389-54f266700cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e99fe12-1af5-4d80-a389-54f266700cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d0303-051e-43d0-af1d-5672a0d2219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume 1e7ad47b-9fea-4b6b-ba20-2a2146912280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280', 'volume_size': 1} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:35 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab" returned: 0 in 0.803s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-3056389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7ad47b-9fea-4b6b-ba20-2a2146912280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:35Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume 1e7ad47b-9fea-4b6b-ba20-2a2146912280 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:35 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:35 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 1073741824 Apr 30 11:13:35 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781f50d2-2b12-4e30-95e9-d7b360f52a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd07d383-7a34-4c92-94d4-3746b373bcab', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2d172-0671-4a0c-9250-cbe847378272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Volume volume-dd07d383-7a34-4c92-94d4-3746b373bcab (dd07d383-7a34-4c92-94d4-3746b373bcab): created successfully Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b2d172-0671-4a0c-9250-cbe847378272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Flow 'volume_create_manager' (f5f86c36-16a2-4e8c-ad6e-1497e647e653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (2618774a-84d0-44dd-a1b8-b3af8512fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28ac1c7-63e3-4c99-88a6-bfd6cdb54676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d28ac1c7-63e3-4c99-88a6-bfd6cdb54676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136026047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37abd923-8e69-4583-b661-b26935dda4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01087e4a-f8c2-4ce2-9a72-e9e4ffbeeda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01087e4a-f8c2-4ce2-9a72-e9e4ffbeeda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e993b2-8d80-4edf-8ddc-b418343a9f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e993b2-8d80-4edf-8ddc-b418343a9f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37abd923-8e69-4583-b661-b26935dda4b1', 'volume_name': 'volume-37abd923-8e69-4583-b661-b26935dda4b1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1047157-b8ab-4b58-a427-623f6779be0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1047157-b8ab-4b58-a427-623f6779be0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089f5fbe-c3a2-4e2f-b4f8-10b014a02b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:35 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume 37abd923-8e69-4583-b661-b26935dda4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37abd923-8e69-4583-b661-b26935dda4b1', 'volume_size': 1} Apr 30 11:13:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e25c7c54-61e9-410b-848b-89dffb00fe22 tempest-VolumesTransfersTest-1085806984 None] Created volume successfully. Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (24113afe-d16a-4087-b553-0c6966f7011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a6c19-758a-4d6e-b80d-1fd94d6480c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a6c19-758a-4d6e-b80d-1fd94d6480c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762599354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2efcdc-15f0-4303-9b07-150a4c55f5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb475c-efd9-44fb-ad76-f87606b85c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fb475c-efd9-44fb-ad76-f87606b85c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edc2ef-1023-4893-8c36-be9a72ebd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edc2ef-1023-4893-8c36-be9a72ebd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2efcdc-15f0-4303-9b07-150a4c55f5d4', 'volume_name': 'volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e773b872-f7d7-4c03-958c-204f61b3f639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e773b872-f7d7-4c03-958c-204f61b3f639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5052c4-27c2-4895-bcc7-a29bd8ef2391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume fa2efcdc-15f0-4303-9b07-150a4c55f5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4', 'volume_size': 1} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (99d6c4ba-b9a2-4887-b722-373fe3579754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d87ceba-aa46-4259-a42d-4d2b8ac89ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d87ceba-aa46-4259-a42d-4d2b8ac89ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-737131491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af38e87-3603-4fe2-aee0-45988bc7f237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6022b5-a13e-49d5-b91a-31afe344f358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6022b5-a13e-49d5-b91a-31afe344f358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e8de1b-6a6c-4e6f-9e15-a9431c9266e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e8de1b-6a6c-4e6f-9e15-a9431c9266e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7af38e87-3603-4fe2-aee0-45988bc7f237', 'volume_name': 'volume-7af38e87-3603-4fe2-aee0-45988bc7f237', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4614f9-7ced-4afd-a828-28d6bd12ba99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4614f9-7ced-4afd-a828-28d6bd12ba99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bccb8f9-f9fd-4bbe-958c-d3005cb2fbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:36 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume 7af38e87-3603-4fe2-aee0-45988bc7f237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7af38e87-3603-4fe2-aee0-45988bc7f237', 'volume_size': 1} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:36 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 1073741824" returned: 0 in 1.132s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:36 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 Apr 30 11:13:36 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:36 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (0f3974dd-b533-4240-ba76-792ef769df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18982518-3814-4895-ad0c-2155cfa96c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18982518-3814-4895-ad0c-2155cfa96c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810326287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d75a000-70d7-4c46-be2d-65735a58b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:37Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026e93a3-fa9d-4ac2-a2e7-6dadbfa74c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026e93a3-fa9d-4ac2-a2e7-6dadbfa74c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5113dcf-7238-4104-9f89-0c9e6d96de92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5113dcf-7238-4104-9f89-0c9e6d96de92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d75a000-70d7-4c46-be2d-65735a58b5f5', 'volume_name': 'volume-3d75a000-70d7-4c46-be2d-65735a58b5f5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3dd988-8481-42fa-84d0-0f03d5291e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3dd988-8481-42fa-84d0-0f03d5291e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0c9cb6-91a4-4219-b713-09f79e2afb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume 3d75a000-70d7-4c46-be2d-65735a58b5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d75a000-70d7-4c46-be2d-65735a58b5f5', 'volume_size': 1} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6f0d3de6-0a4a-4b4f-8a0f-c347974965a6 tempest-VolumesTransfersTest-1142114711 None] Transfer volume completed successfully. Apr 30 11:13:37 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280" returned: 0 in 0.695s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2136026047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37abd923-8e69-4583-b661-b26935dda4b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume 37abd923-8e69-4583-b661-b26935dda4b1 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:37 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:37 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 1073741824 Apr 30 11:13:37 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb0d0303-051e-43d0-af1d-5672a0d2219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753df6e5-4e97-4a0f-a81f-533b2df2b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 (1e7ad47b-9fea-4b6b-ba20-2a2146912280): created successfully Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (753df6e5-4e97-4a0f-a81f-533b2df2b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (ae6c4f1a-d181-4e71-8ea4-f928a9d3f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c2c24a5f-ea81-4bf5-9afc-112f8c5c467a tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "cinder-dd07d383-7a34-4c92-94d4-3746b373bcab-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-dd07d383-7a34-4c92-94d4-3746b373bcab-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "cinder-quobyte-dd07d383-7a34-4c92-94d4-3746b373bcab" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-quobyte-dd07d383-7a34-4c92-94d4-3746b373bcab" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a13e1c-ad44-45d8-8488-7f5acb8fe217]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:38 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 1073741824" returned: 0 in 0.849s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:38 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab Apr 30 11:13:38 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:38 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 Apr 30 11:13:38 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:39 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab" returned: 0 in 0.811s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:39 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1" returned: 0 in 0.683s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.884s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1762599354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2efcdc-15f0-4303-9b07-150a4c55f5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume fa2efcdc-15f0-4303-9b07-150a4c55f5d4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:39 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab Apr 30 11:13:39 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:39 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:39 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 1073741824 Apr 30 11:13:39 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (089f5fbe-c3a2-4e2f-b4f8-10b014a02b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37abd923-8e69-4583-b661-b26935dda4b1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d38f52-19e7-47ab-ae56-41b16b4a48cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:39 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-37abd923-8e69-4583-b661-b26935dda4b1 (37abd923-8e69-4583-b661-b26935dda4b1): created successfully Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d38f52-19e7-47ab-ae56-41b16b4a48cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (2618774a-84d0-44dd-a1b8-b3af8512fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f6dd1457-2cbc-4563-948c-ceeb3e1b6564 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:39 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-dd07d383-7a34-4c92-94d4-3746b373bcab" returned: 0 in 0.659s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-quobyte-dd07d383-7a34-4c92-94d4-3746b373bcab" released by "delete_volume" :: held 1.512s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Created reservations ['d8580e74-4a94-45f7-8b37-d76e7aad0b49', '1ce5e06b-56bf-4376-a6c3-8c5cf56097fe', '495ac776-3d84-427b-a935-d2e187029c06', 'fca542fa-551a-4552-9250-410fbb44a47e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:39 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:39 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:40 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 1073741824" returned: 0 in 0.868s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:40 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 Apr 30 11:13:40 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:40 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Deleted volume successfully. Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3a504ac4-a966-4261-8c18-f6ed28474ff0 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-dd07d383-7a34-4c92-94d4-3746b373bcab-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:40 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.184s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-737131491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7af38e87-3603-4fe2-aee0-45988bc7f237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:36Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume 7af38e87-3603-4fe2-aee0-45988bc7f237 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:40 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:40 devstack sudo[91703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 1073741824 Apr 30 11:13:40 devstack sudo[91703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5052c4-27c2-4895-bcc7-a29bd8ef2391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fcc999-dd39-4c99-b7c6-a0a78f2d24ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:40 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 (fa2efcdc-15f0-4303-9b07-150a4c55f5d4): created successfully Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1fcc999-dd39-4c99-b7c6-a0a78f2d24ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:40 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (24113afe-d16a-4087-b553-0c6966f7011c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:40 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-32b698ed-ea86-4394-a494-5d475796fc1f tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Flow 'volume_create_manager' (75e32f74-28cf-4b8c-8815-afbf076769ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f59c49-a7df-45ab-9f8c-390e67770d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f59c49-a7df-45ab-9f8c-390e67770d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-325415573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f26815-6815-461b-b661-44c4adb5bfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7b02167894380a21ff6d7f1cdcc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:41Z,use_quota=True,user_id='84951b94bff2447c934091fe0461560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80271002-4b29-4df6-aef8-dca048b8f760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80271002-4b29-4df6-aef8-dca048b8f760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d4d728-ead8-4acb-aac4-b24e14f0e83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d4d728-ead8-4acb-aac4-b24e14f0e83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f26815-6815-461b-b661-44c4adb5bfd4', 'volume_name': 'volume-89f26815-6815-461b-b661-44c4adb5bfd4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d0fc0e-8bbb-4a06-8aad-43b34f404a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d0fc0e-8bbb-4a06-8aad-43b34f404a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f62b21-6bf5-4b59-a845-45c70cd07346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:41 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Volume 89f26815-6815-461b-b661-44c4adb5bfd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f26815-6815-461b-b661-44c4adb5bfd4', 'volume_size': 1} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:41 devstack sudo[91703]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 1073741824" returned: 0 in 0.880s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:41 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 Apr 30 11:13:41 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:42 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237" returned: 0 in 0.678s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.342s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-810326287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d75a000-70d7-4c46-be2d-65735a58b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26cc4717552450583d3914706b5715f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:37Z,use_quota=True,user_id='9aeab269cdaf4ba6af6282516ca02453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Creating volume 3d75a000-70d7-4c46-be2d-65735a58b5f5 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:42 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bccb8f9-f9fd-4bbe-958c-d3005cb2fbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7af38e87-3603-4fe2-aee0-45988bc7f237', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450aee9-cb5f-4a42-a9cd-26a877df8215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:42 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 1073741824 Apr 30 11:13:42 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:42 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-7af38e87-3603-4fe2-aee0-45988bc7f237 (7af38e87-3603-4fe2-aee0-45988bc7f237): created successfully Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450aee9-cb5f-4a42-a9cd-26a877df8215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (99d6c4ba-b9a2-4887-b722-373fe3579754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-70c83fd6-8d28-4687-bd09-60a74c6b1812 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:43 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 1073741824" returned: 0 in 0.849s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:43 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 Apr 30 11:13:43 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:43 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5" returned: 0 in 0.575s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.781s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-325415573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f26815-6815-461b-b661-44c4adb5bfd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7b02167894380a21ff6d7f1cdcc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:41Z,use_quota=True,user_id='84951b94bff2447c934091fe0461560f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Creating volume 89f26815-6815-461b-b661-44c4adb5bfd4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:43 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:43 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 1073741824 Apr 30 11:13:43 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0c9cb6-91a4-4219-b713-09f79e2afb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d75a000-70d7-4c46-be2d-65735a58b5f5', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8484de9-c9f9-4817-b237-d13413642077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:43 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Volume volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 (3d75a000-70d7-4c46-be2d-65735a58b5f5): created successfully Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8484de9-c9f9-4817-b237-d13413642077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Flow 'volume_create_manager' (0f3974dd-b533-4240-ba76-792ef769df30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f7921140-65cb-4c75-a6b7-c8d6ed787536 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created volume successfully. Apr 30 11:13:44 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-3d75a000-70d7-4c46-be2d-65735a58b5f5-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 1073741824" returned: 0 in 0.890s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-3d75a000-70d7-4c46-be2d-65735a58b5f5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-3d75a000-70d7-4c46-be2d-65735a58b5f5" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:44 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 Apr 30 11:13:44 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-3d75a000-70d7-4c46-be2d-65735a58b5f5" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8ae94a-be89-4175-9f97-34890daa5fc8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:45 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 Apr 30 11:13:45 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:45 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4" returned: 0 in 0.652s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f62b21-6bf5-4b59-a845-45c70cd07346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f26815-6815-461b-b661-44c4adb5bfd4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f492e-2285-4d8a-8781-c21ec4d2e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:45 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Volume volume-89f26815-6815-461b-b661-44c4adb5bfd4 (89f26815-6815-461b-b661-44c4adb5bfd4): created successfully Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e3f492e-2285-4d8a-8781-c21ec4d2e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Flow 'volume_create_manager' (75e32f74-28cf-4b8c-8815-afbf076769ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8b8f9123-7575-4048-965d-c698397736dc tempest-VolumesTransfersTest-1085806984 None] Created volume successfully. Apr 30 11:13:45 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5" returned: 0 in 0.782s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:45 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5 Apr 30 11:13:45 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:46 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3d75a000-70d7-4c46-be2d-65735a58b5f5" returned: 0 in 0.634s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-3d75a000-70d7-4c46-be2d-65735a58b5f5" released by "delete_volume" :: held 1.470s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['378d87a4-aef2-4217-a68e-36df3f7a9639', 'ad4844a0-ff14-47c0-86c8-df551d2f1378', '5d51815a-48fb-4bdf-a953-1c2d173e6a82', '4f326a26-84dc-41e4-b59c-68e18498d95b'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:46 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:46 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "cinder-89f26815-6815-461b-b661-44c4adb5bfd4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-89f26815-6815-461b-b661-44c4adb5bfd4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "cinder-quobyte-89f26815-6815-461b-b661-44c4adb5bfd4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-quobyte-89f26815-6815-461b-b661-44c4adb5bfd4" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90ab40-3f4b-43ba-bd85-2a822325d76c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:46 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 Apr 30 11:13:46 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-7af38e87-3603-4fe2-aee0-45988bc7f237-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-7af38e87-3603-4fe2-aee0-45988bc7f237-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-7af38e87-3603-4fe2-aee0-45988bc7f237" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-7af38e87-3603-4fe2-aee0-45988bc7f237" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:47 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.668s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[258646bc-6f17-476a-9a97-e6093487c43a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-17f0f1d3-3660-4c39-b019-3eec726f0b5b tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-3d75a000-70d7-4c46-be2d-65735a58b5f5-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:47 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 Apr 30 11:13:47 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:47 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4" returned: 0 in 1.108s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:47 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4 Apr 30 11:13:47 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:48 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237" returned: 0 in 1.296s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:48 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237 Apr 30 11:13:48 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:48 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-89f26815-6815-461b-b661-44c4adb5bfd4" returned: 0 in 0.912s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-quobyte-89f26815-6815-461b-b661-44c4adb5bfd4" released by "delete_volume" :: held 2.079s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Created reservations ['c47bd509-be6e-4f57-ad4b-58c8d97eb4f5', '0b6cdef8-4174-42ca-ab89-82a836872362', '3bf5344d-9d20-4f95-970c-fb2e6d68fc4d', '81a476bb-9ea5-4b63-8f8c-f647833eecf3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:49 devstack sudo[91879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:49 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:49 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7af38e87-3603-4fe2-aee0-45988bc7f237" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-7af38e87-3603-4fe2-aee0-45988bc7f237" released by "delete_volume" :: held 2.139s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['89c5900d-8fd3-4f29-a08c-419513da1167', 'e64736ac-bff2-4cd3-8774-714c820156a9', '4a27eea8-7e3f-4574-85b4-721257e0cdad', '218aa174-4015-497e-8aa7-8dd2d35c004e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:49 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:49 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:50 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.133s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Deleted volume successfully. Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3051cf90-2ea4-4c9a-acf8-ecbac5906e74 tempest-VolumesTransfersTest-97274671 None] Lock "cinder-89f26815-6815-461b-b661-44c4adb5bfd4-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:50 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.876s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1c8264cd-d9e8-4b92-82d2-9f68bd7b1538 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-7af38e87-3603-4fe2-aee0-45988bc7f237-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-fa2efcdc-15f0-4303-9b07-150a4c55f5d4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-fa2efcdc-15f0-4303-9b07-150a4c55f5d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26255d6-03d0-487e-9b6d-3791b7ca5ffd]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:50 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 Apr 30 11:13:50 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:51 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" returned: 0 in 0.923s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:51 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4 Apr 30 11:13:51 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ac62ce90-4d82-46a8-93b2-f7518d316bb2 tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" by "attach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ac62ce90-4d82-46a8-93b2-f7518d316bb2 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" acquired by "attach_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ac62ce90-4d82-46a8-93b2-f7518d316bb2 tempest-VolumesActionsTest-652539150 None] Attaching volume 5f7484b8-8763-4626-a374-c5343a93a926 to instance 213eb454-5f40-431e-b7b0-b3f6a116dfee at mountpoint /dev/vdb on host None. Apr 30 11:13:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ac62ce90-4d82-46a8-93b2-f7518d316bb2 tempest-VolumesActionsTest-652539150 None] Attach volume completed successfully. Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ac62ce90-4d82-46a8-93b2-f7518d316bb2 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926" released by "attach_volume" :: held 0.104s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:52 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" returned: 0 in 0.825s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-fa2efcdc-15f0-4303-9b07-150a4c55f5d4" released by "delete_volume" :: held 1.799s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['0a90ced7-64df-4ba2-a0ba-86519d546b69', '7b82b3a7-bd25-47af-a987-d43306be3075', '829e9966-8387-4992-bb27-65354b6c51ba', 'fb37b7d2-eba7-4d7a-9886-5bcdf4e7f921'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:52 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:52 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ac6d2e6-eebc-4c8f-ae58-0883b8245f92 tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" by "detach_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ac6d2e6-eebc-4c8f-ae58-0883b8245f92 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8ac6d2e6-eebc-4c8f-ae58-0883b8245f92 tempest-VolumesActionsTest-652539150 None] Detaching volume 5f7484b8-8763-4626-a374-c5343a93a926 from instance 213eb454-5f40-431e-b7b0-b3f6a116dfee. Apr 30 11:13:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8ac6d2e6-eebc-4c8f-ae58-0883b8245f92 tempest-VolumesActionsTest-652539150 None] Detach volume completed successfully. Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-8ac6d2e6-eebc-4c8f-ae58-0883b8245f92 tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-37abd923-8e69-4583-b661-b26935dda4b1-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-37abd923-8e69-4583-b661-b26935dda4b1-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-37abd923-8e69-4583-b661-b26935dda4b1" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-37abd923-8e69-4583-b661-b26935dda4b1" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34ac12-773e-439e-9dcf-97281f78c139]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:53 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 Apr 30 11:13:53 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:53 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.088s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:53 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:53 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:13:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-78dc1d9a-c1a2-4607-aa66-6525741486c3 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-fa2efcdc-15f0-4303-9b07-150a4c55f5d4-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:53 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1" returned: 0 in 1.046s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:54 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1 Apr 30 11:13:54 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:54 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-37abd923-8e69-4583-b661-b26935dda4b1" returned: 0 in 0.797s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-37abd923-8e69-4583-b661-b26935dda4b1" released by "delete_volume" :: held 1.920s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:54 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['236523d0-53d6-4a81-99fd-1adb8a6c1a02', '1ee363b7-3d64-4e05-aacd-0c1f41b25aac', '43add087-bbe1-4bf6-8e35-c87f8dde577f', 'dda48372-1bf2-46d2-9e07-30f4b66eddbd'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:55 devstack sudo[91952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:55 devstack sudo[91952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-1e7ad47b-9fea-4b6b-ba20-2a2146912280-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-1e7ad47b-9fea-4b6b-ba20-2a2146912280-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-1e7ad47b-9fea-4b6b-ba20-2a2146912280" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-1e7ad47b-9fea-4b6b-ba20-2a2146912280" acquired by "delete_volume" :: waited 0.041s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd8ea8-ff48-4efe-af7a-26c8a310693a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:55 devstack sudo[91954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 Apr 30 11:13:55 devstack sudo[91954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:56 devstack sudo[91952]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.949s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:56 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:13:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7bcf953f-01a9-42cd-a354-e4ecb549402f tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-37abd923-8e69-4583-b661-b26935dda4b1-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:56 devstack sudo[91954]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280" returned: 0 in 0.959s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:56 devstack sudo[91964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280 Apr 30 11:13:56 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:57 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-1e7ad47b-9fea-4b6b-ba20-2a2146912280" returned: 0 in 0.745s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-1e7ad47b-9fea-4b6b-ba20-2a2146912280" released by "delete_volume" :: held 1.798s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['e72fb2e8-ec37-45dc-af17-b27587b00d7f', '526e9ae5-b503-491d-8017-f6cfa06b1a15', 'd3c49a8c-1e34-4768-aefe-36270e921466', 'c6796b27-a0e0-41f8-b3b9-21ff04d7b62a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Flow 'volume_create_manager' (86470258-c34a-4220-beeb-9a86bd2fbd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4817d939-a7b0-43c2-be0c-ac46d2c4bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4817d939-a7b0-43c2-be0c-ac46d2c4bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1721681802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132237b1-fe45-44a2-9dc8-e5899419c940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d64a433114335b7dd8b4c60d9c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:57Z,use_quota=True,user_id='e849345b143b45efa38d8d809cca65ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95055732-fc3a-42d2-964f-255a73971580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95055732-fc3a-42d2-964f-255a73971580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c7a72a-3229-4091-b354-2b36981a16b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c7a72a-3229-4091-b354-2b36981a16b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132237b1-fe45-44a2-9dc8-e5899419c940', 'volume_name': 'volume-132237b1-fe45-44a2-9dc8-e5899419c940', 'volume_size': 2}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a954db7-4627-4379-aa61-88259c91db43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a954db7-4627-4379-aa61-88259c91db43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d32347-e08d-4510-8f31-3c19b9e61697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:57 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Volume 132237b1-fe45-44a2-9dc8-e5899419c940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132237b1-fe45-44a2-9dc8-e5899419c940', 'volume_size': 2} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1721681802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132237b1-fe45-44a2-9dc8-e5899419c940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883d64a433114335b7dd8b4c60d9c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:13:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:13:57Z,use_quota=True,user_id='e849345b143b45efa38d8d809cca65ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Creating volume 132237b1-fe45-44a2-9dc8-e5899419c940 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:13:57 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 2147483648 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:57 devstack sudo[91968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 2147483648 Apr 30 11:13:57 devstack sudo[91968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:57 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:13:57 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-c1eecfb0-e759-43be-8b96-c70292e9328c-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-c1eecfb0-e759-43be-8b96-c70292e9328c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-c1eecfb0-e759-43be-8b96-c70292e9328c" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-c1eecfb0-e759-43be-8b96-c70292e9328c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleting offline snapshot c1eecfb0-e759-43be-8b96-c70292e9328c of volume 36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] snapshot_file for this snap is: volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2c09c4-3fcb-4200-bc6c-348749df3920]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:57 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c Apr 30 11:13:57 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:58 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.717s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:13:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1cbd2451-4835-4e19-a7dc-45611aaa707e tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-1e7ad47b-9fea-4b6b-ba20-2a2146912280-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:13:58 devstack sudo[91968]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 2147483648" returned: 0 in 0.995s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:58 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 Apr 30 11:13:58 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:58 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c" returned: 0 in 0.826s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c1e253-f561-4610-82ce-da53ce6e1989]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:58 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 Apr 30 11:13:58 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:58 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940" returned: 0 in 0.626s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d32347-e08d-4510-8f31-3c19b9e61697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132237b1-fe45-44a2-9dc8-e5899419c940', 'volume_size': 2}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6163e557-08b8-4c3c-8847-09cd5f1dbca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:13:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Volume volume-132237b1-fe45-44a2-9dc8-e5899419c940 (132237b1-fe45-44a2-9dc8-e5899419c940): created successfully Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6163e557-08b8-4c3c-8847-09cd5f1dbca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Flow 'volume_create_manager' (86470258-c34a-4220-beeb-9a86bd2fbd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:13:59 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-11874e8d-2239-4e9e-830a-3e3d82c8031d tempest-VolumesCloneNegativeTest-1255102859 None] Created volume successfully. Apr 30 11:13:59 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:59 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c Apr 30 11:13:59 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Acquiring lock "cinder-132237b1-fe45-44a2-9dc8-e5899419c940-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "cinder-132237b1-fe45-44a2-9dc8-e5899419c940-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Acquiring lock "cinder-quobyte-132237b1-fe45-44a2-9dc8-e5899419c940" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "cinder-quobyte-132237b1-fe45-44a2-9dc8-e5899419c940" acquired by "delete_volume" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe2f0ac-3a1f-4ad9-bd6f-b311524a95f2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:13:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:13:59 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 Apr 30 11:13:59 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c" returned: 0 in 0.767s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:00 devstack sudo[92001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c Apr 30 11:14:00 devstack sudo[92001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940" returned: 0 in 0.847s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:00 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940 Apr 30 11:14:00 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:00 devstack sudo[92001]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6.c1eecfb0-e759-43be-8b96-c70292e9328c" returned: 0 in 0.653s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-c1eecfb0-e759-43be-8b96-c70292e9328c" released by "_delete_snapshot" :: held 3.187s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" released by "delete_snapshot" :: held 3.215s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['7e8723a3-7728-4634-a912-613be3fbd492', '0a92a933-9d2b-42e5-80ec-40258726cda2', '7366ae23-1f5a-46f2-b2c0-66c82e28a791', '25599503-3015-4f71-b261-9e9e25b707db'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Delete snapshot completed successfully. Apr 30 11:14:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b163cdd3-2d32-4e37-bdd7-1986a796edaf tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-c1eecfb0-e759-43be-8b96-c70292e9328c-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:01 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-132237b1-fe45-44a2-9dc8-e5899419c940" returned: 0 in 0.657s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "cinder-quobyte-132237b1-fe45-44a2-9dc8-e5899419c940" released by "delete_volume" :: held 1.549s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Created reservations ['268c5852-5dc5-4797-bdf2-a8968f808a41', '35065eba-6294-4c69-a140-49130cf05398', 'cba6eb24-042a-4846-bcb3-e12bb11b7e18', '7af99a5b-a632-47c4-a520-102c4d811191'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:01 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:01 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-36fbef74-5bc5-4852-bc2f-5b28f198b4c6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-36fbef74-5bc5-4852-bc2f-5b28f198b4c6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" acquired by "delete_volume" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[969d59f5-963d-4a11-a053-42ae455ae81c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:02 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.763s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:02 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Deleted volume successfully. Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-419ec19a-05b8-4db0-8bfa-9daf2b3f38d8 tempest-VolumesCloneNegativeTest-1255102859 None] Lock "cinder-132237b1-fe45-44a2-9dc8-e5899419c940-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:02 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 Apr 30 11:14:02 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aeb729-d170-4b74-b672-64f327d96a9c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:02 devstack sudo[92015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:02 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:02 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" returned: 0 in 0.850s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:02 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6 Apr 30 11:14:02 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:03 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.941s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2898c5c2-af01-4a7f-84b5-80cabf657075]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:03 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:03 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:03 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" returned: 0 in 0.763s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-quobyte-36fbef74-5bc5-4852-bc2f-5b28f198b4c6" released by "delete_volume" :: held 1.699s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Created reservations ['f94d0352-59f2-49ce-82cd-e0e154292a4c', '11534b89-b6f8-4bdf-ae42-137e55c27292', '1fe8b9fe-1285-40cf-a450-e3441d902733', '31f1e99f-70ad-4f87-9cf9-f26ebe0bfacf'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:03 devstack sudo[92029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:03 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:04 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.855s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.54e5c232-149e-49a8-88ee-e086d27bb77eu70w22ty.img {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:04 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.54e5c232-149e-49a8-88ee-e086d27bb77eu70w22ty.img Apr 30 11:14:04 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:04 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.814s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:04 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Deleted volume successfully. Apr 30 11:14:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7ce38300-5863-4061-9886-6ea68ca23ff2 tempest-CreateVolumesFromSnapshotTest-869720420 None] Lock "cinder-36fbef74-5bc5-4852-bc2f-5b28f198b4c6-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:07 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:07 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:07 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.936s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Flow 'volume_create_manager' (7e822f45-e7c4-4119-8d44-1229394d7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f8a60e-2b6f-4e03-bfff-0083bcb5571b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f8a60e-2b6f-4e03-bfff-0083bcb5571b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-281439490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04634384-dd9d-415c-bc33-9b2c2fa354a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7bc3cb06a4a7588a9b3960ac9976b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:08Z,use_quota=True,user_id='c0976d02ecf44040b5a72e6c26a26c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c0ce40-687f-40ad-86c0-c57b4f2a6bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35c0ce40-687f-40ad-86c0-c57b4f2a6bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0280e308-cd93-42d5-82dc-b504447eca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:08 devstack cinder-volume[84206]: DEBUG cinder.image.glance [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Creating Keystone auth plugin from conf {{(pid=84206) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:14:10 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.54e5c232-149e-49a8-88ee-e086d27bb77eu70w22ty.img" returned: 0 in 6.048s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[727e6069-6fd2-41db-bd68-52edd0437220]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0280e308-cd93-42d5-82dc-b504447eca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04634384-dd9d-415c-bc33-9b2c2fa354a5', 'volume_name': 'volume-04634384-dd9d-415c-bc33-9b2c2fa354a5', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293a915-6647-4dd8-a006-117516fe6856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5293a915-6647-4dd8-a006-117516fe6856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121915a5-34bf-461e-8610-4635b90f0e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Volume 04634384-dd9d-415c-bc33-9b2c2fa354a5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04634384-dd9d-415c-bc33-9b2c2fa354a5', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Trying to clone 04634384-dd9d-415c-bc33-9b2c2fa354a5 from image 9165766b-a0b9-4919-8d55-0a96e0f54340 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]). {{(pid=84206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 30 11:14:10 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:10 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:14:10 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc408c9e-edb2-40b4-8efe-55851f94208d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=112,cinder:INSERT=36,cinder:UPDATE=152,cinder:DELETE=13 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (a7f46b55-6e9b-41b1-92ef-b6780558f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bf8079-5f15-44a0-b5d1-712f09a4cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bf8079-5f15-44a0-b5d1-712f09a4cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647309586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd10cf4b-b45a-4582-9e5b-530d1788e8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:11Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f05da5-c9e8-4c9f-afe7-cba54fc75a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f05da5-c9e8-4c9f-afe7-cba54fc75a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716f9b11-865f-4361-b0f3-8c993ad51ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (716f9b11-865f-4361-b0f3-8c993ad51ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd10cf4b-b45a-4582-9e5b-530d1788e8f4', 'volume_name': 'volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05841113-2c43-4922-8b73-0a67da2b46ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05841113-2c43-4922-8b73-0a67da2b46ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626a2cfa-c999-44f0-af98-ca65ef08dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume fd10cf4b-b45a-4582-9e5b-530d1788e8f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4', 'volume_size': 1} Apr 30 11:14:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:10 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD Apr 30 11:14:10 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:11 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.974s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.54e5c232-149e-49a8-88ee-e086d27bb77eu70w22ty.img {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:11 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Converted 1024.00 MB image at 169.29 MB/s Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] 54e5c232-149e-49a8-88ee-e086d27bb77e was raw, no need to convert to raw {{(pid=84206) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 30 11:14:11 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 is fetched for user c0976d02ecf44040b5a72e6c26a26c7c. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ce87cd-8159-4dfc-86e3-c60ad02cead9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:11 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD Apr 30 11:14:11 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:12 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:21 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=111,cinder:INSERT=35,cinder:UPDATE=140,cinder:DELETE=10 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:14:21 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=2,cinder:INSERT=1 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.960s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Uploaded volume to glance image-id: 54e5c232-149e-49a8-88ee-e086d27bb77e. {{(pid=84206) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.288s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647309586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd10cf4b-b45a-4582-9e5b-530d1788e8f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:11Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume fd10cf4b-b45a-4582-9e5b-530d1788e8f4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:30 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:30 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 1073741824 Apr 30 11:14:30 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-461ab719-7f7c-43f3-9fe5-15b51369585e tempest-VolumesActionsTest-652539150 None] Copy volume to image completed successfully. Apr 30 11:14:31 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 1073741824" returned: 0 in 0.954s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:31 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 Apr 30 11:14:31 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:31 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" returned: 0 in 0.616s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.586s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-281439490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04634384-dd9d-415c-bc33-9b2c2fa354a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7bc3cb06a4a7588a9b3960ac9976b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:08Z,use_quota=True,user_id='c0976d02ecf44040b5a72e6c26a26c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Creating volume 04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:31 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:31 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1073741824 Apr 30 11:14:31 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (626a2cfa-c999-44f0-af98-ca65ef08dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033bb576-6e4b-492c-af91-076500e35873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 (fd10cf4b-b45a-4582-9e5b-530d1788e8f4): created successfully Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (033bb576-6e4b-492c-af91-076500e35873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (a7f46b55-6e9b-41b1-92ef-b6780558f069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b96942e6-4fd7-4e28-a2d1-751aeab4906d tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (a404aced-68bb-44e2-abf8-ecdd91ab9abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b48d8e-bbfe-434a-a57e-76a30451e8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16b48d8e-bbfe-434a-a57e-76a30451e8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674152665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3e1b33-1586-413a-885a-53258fd2ee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a703c4ed-9af4-4a6f-9afd-34c266ff899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a703c4ed-9af4-4a6f-9afd-34c266ff899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875de42c-2578-4922-aa3b-86685f9726b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875de42c-2578-4922-aa3b-86685f9726b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e3e1b33-1586-413a-885a-53258fd2ee7a', 'volume_name': 'volume-7e3e1b33-1586-413a-885a-53258fd2ee7a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd29bd8-4a43-4e57-93bd-9fade3f72b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afd29bd8-4a43-4e57-93bd-9fade3f72b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:32 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bd516d-099f-4187-a988-558f2e21d36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume 7e3e1b33-1586-413a-885a-53258fd2ee7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e3e1b33-1586-413a-885a-53258fd2ee7a', 'volume_size': 1} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1073741824" returned: 0 in 0.987s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:32 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:32 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (3f3f3864-e09c-4599-8b95-40301c23c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84873a8d-28dd-4885-aa23-3bb4f3d14616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84873a8d-28dd-4885-aa23-3bb4f3d14616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246663817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e29015-c7d9-49b2-a8ad-6c952068e83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c409f69b-f84d-431a-b7ff-51084709bf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c409f69b-f84d-431a-b7ff-51084709bf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34458d39-1db6-492a-aa19-212051b23ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34458d39-1db6-492a-aa19-212051b23ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e29015-c7d9-49b2-a8ad-6c952068e83e', 'volume_name': 'volume-65e29015-c7d9-49b2-a8ad-6c952068e83e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483f633f-fe28-43fa-b8cc-cc3d374ca951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (483f633f-fe28-43fa-b8cc-cc3d374ca951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64acaa76-f056-46f6-8359-99ad098eb29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume 65e29015-c7d9-49b2-a8ad-6c952068e83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e29015-c7d9-49b2-a8ad-6c952068e83e', 'volume_size': 1} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (efd7f622-7fa2-415a-9ebd-5f6bd5eb7571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286eaf8a-5552-4a0f-bbfb-3509555df7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286eaf8a-5552-4a0f-bbfb-3509555df7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830757367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf68d47-0415-47a8-aa5a-1eeef1e2de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5859f8c3-2ecf-4b4e-9aa9-3d9d7e70f853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5859f8c3-2ecf-4b4e-9aa9-3d9d7e70f853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0795adcc-f2c8-448f-9615-3797a364de24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0795adcc-f2c8-448f-9615-3797a364de24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf68d47-0415-47a8-aa5a-1eeef1e2de16', 'volume_name': 'volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9360d8-7141-41ba-a82e-622f6f7e8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf9360d8-7141-41ba-a82e-622f6f7e8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b628ed-065a-4861-87b0-893cb4407532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume 2bf68d47-0415-47a8-aa5a-1eeef1e2de16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16', 'volume_size': 1} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 0.718s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.184s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc628ca-f2dd-4b1f-aab4-2a7918608bea]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Attempting download of 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume 04634384-dd9d-415c-bc33-9b2c2fa354a5. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99965f-209e-4bc0-b735-b5e4c4cd6b1a]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:33 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:33 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:33 devstack sudo[92089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy Apr 30 11:14:33 devstack sudo[92089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (0ad0d256-8d3a-41a4-ac50-c0908659c9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8167adb-dcc5-468c-b9d8-1da3221046ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8167adb-dcc5-468c-b9d8-1da3221046ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84024331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80caa884-5101-4568-990b-a27775ae9e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:34Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fb17a7-6806-4d31-b4ae-cffa473aabf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fb17a7-6806-4d31-b4ae-cffa473aabf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a2485d-8d70-4482-8c83-fe6dc4d47168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27a2485d-8d70-4482-8c83-fe6dc4d47168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80caa884-5101-4568-990b-a27775ae9e4e', 'volume_name': 'volume-80caa884-5101-4568-990b-a27775ae9e4e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bd3db8-fda3-440b-83d5-8c12826a445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85bd3db8-fda3-440b-83d5-8c12826a445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be33535d-2caa-4d5a-b17e-add3f2237bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume 80caa884-5101-4568-990b-a27775ae9e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80caa884-5101-4568-990b-a27775ae9e4e', 'volume_size': 1} Apr 30 11:14:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (815a8af9-83bf-46bd-aa4d-a5abb923523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e03b930-1e43-4ebc-83df-a5f954904dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e03b930-1e43-4ebc-83df-a5f954904dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128398523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db8d4c6-d15e-4946-94ef-6a950748683d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:34Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e96228c-4835-48e6-ab41-fb2dfb27a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e96228c-4835-48e6-ab41-fb2dfb27a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b1a7ff-2692-4f4a-ba90-cef08e092f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b1a7ff-2692-4f4a-ba90-cef08e092f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db8d4c6-d15e-4946-94ef-6a950748683d', 'volume_name': 'volume-8db8d4c6-d15e-4946-94ef-6a950748683d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9ada50-1b62-43ed-a079-942a5fc0679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b9ada50-1b62-43ed-a079-942a5fc0679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249cf593-0086-4ef1-b84f-f7b76d35b000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:34 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume 8db8d4c6-d15e-4946-94ef-6a950748683d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db8d4c6-d15e-4946-94ef-6a950748683d', 'volume_size': 1} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:34 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.901s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348adac-b543-4330-8842-cd3c874b0f35]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:34 devstack sudo[92089]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy" returned: 0 in 0.876s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:34 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:34 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:34 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy Apr 30 11:14:34 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:35 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.726s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:35 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img Apr 30 11:14:35 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:35 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy" returned: 1 in 0.798s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_amx8xmqy' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d2a719-c1a0-4916-a72a-e11c757984d9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:35 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD Apr 30 11:14:35 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:36 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:36 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] 9165766b-a0b9-4919-8d55-0a96e0f54340 was qcow2, converting to raw {{(pid=84206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:14:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:36 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:36 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:40 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 4.064s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_3nlovhondevstack@QuobyteHD, size 112.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:40 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Converted 112.00 MB image at 27.54 MB/s Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:40 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1G Apr 30 11:14:40 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:40 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img" returned: 0 in 5.253s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16b6877-0007-4b39-856c-fec5bd05e089]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:40 devstack sudo[92137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:40 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:41 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 1G" returned: 0 in 0.871s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb518671-5704-4f2e-893e-2780e2a339b5]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:41 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:41 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:41 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.951s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:41 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Converted 1024.00 MB image at 194.90 MB/s Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] 59538b74-f37b-43f3-af5d-4ee6612f798a was raw, converting to qcow2 {{(pid=84206) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c451ca-baf8-4c45-b0e9-5b22e22026b6]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:41 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img Apr 30 11:14:41 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:41 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 0.778s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:42 devstack sudo[92151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:42 devstack sudo[92151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:42 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img" returned: 0 in 0.840s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:42 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img Apr 30 11:14:42 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:42 devstack sudo[92151]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 1 in 0.782s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Downloaded image 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume 04634384-dd9d-415c-bc33-9b2c2fa354a5 successfully. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 for user c0976d02ecf44040b5a72e6c26a26c7c is deleted. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Marking volume 04634384-dd9d-415c-bc33-9b2c2fa354a5 as bootable. {{(pid=84206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Copying metadata from image 9165766b-a0b9-4919-8d55-0a96e0f54340 to 04634384-dd9d-415c-bc33-9b2c2fa354a5. {{(pid=84206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Creating volume glance metadata for volume 04634384-dd9d-415c-bc33-9b2c2fa354a5 backed by image 9165766b-a0b9-4919-8d55-0a96e0f54340 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121915a5-34bf-461e-8610-4635b90f0e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04634384-dd9d-415c-bc33-9b2c2fa354a5', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308b4447-823c-4f99-811d-24a274b40460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:42 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Volume volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 (04634384-dd9d-415c-bc33-9b2c2fa354a5): created successfully Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (308b4447-823c-4f99-811d-24a274b40460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:42 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Flow 'volume_create_manager' (7e822f45-e7c4-4119-8d44-1229394d7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-53d8470b-5c02-40e8-87dd-a836ee33b2ee tempest-VolumesExtendTest-1071578354 None] Created volume successfully. Apr 30 11:14:43 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img" returned: 1 in 0.778s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img /opt/stack/data/cinder/conversion/vol_upload__i29h56g {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:43 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img /opt/stack/data/cinder/conversion/vol_upload__i29h56g Apr 30 11:14:43 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:43 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img /opt/stack/data/cinder/conversion/vol_upload__i29h56g" returned: 0 in 0.647s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Image conversion details: src /opt/stack/data/cinder/conversion/5f7484b8-8763-4626-a374-c5343a93a926.temp_image.59538b74-f37b-43f3-af5d-4ee6612f798a_eqyxn0d.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__i29h56g {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:14:43 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3189f7db-fa07-4abc-869d-d83b8d631941]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__i29h56g {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:43 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__i29h56g Apr 30 11:14:43 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:44 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__i29h56g" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.432s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Uploaded volume to glance image-id: 59538b74-f37b-43f3-af5d-4ee6612f798a. {{(pid=84206) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.201s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1674152665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e3e1b33-1586-413a-885a-53258fd2ee7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume 7e3e1b33-1586-413a-885a-53258fd2ee7a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:45 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:45 devstack sudo[92177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a 1073741824 Apr 30 11:14:45 devstack sudo[92177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ad02023c-89c2-46bb-8e06-111ec8693de9 tempest-VolumesActionsTest-652539150 None] Copy volume to image completed successfully. Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Acquiring lock "cinder-quobyte-5f7484b8-8763-4626-a374-c5343a93a926" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:46 devstack sudo[92177]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a 1073741824" returned: 0 in 0.945s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "cinder-quobyte-5f7484b8-8763-4626-a374-c5343a93a926" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ceb94a-304a-4945-8684-f9d26a4988fc]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:47 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a Apr 30 11:14:47 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:47 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:47 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:47 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a" returned: 0 in 0.675s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.476s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1246663817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e29015-c7d9-49b2-a8ad-6c952068e83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume 65e29015-c7d9-49b2-a8ad-6c952068e83e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:47 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:47 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.737s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:47 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e 1073741824 Apr 30 11:14:47 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bd516d-099f-4187-a988-558f2e21d36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e3e1b33-1586-413a-885a-53258fd2ee7a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c9940-6bbe-442c-bc0d-e07abba48c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:47 devstack sudo[92228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926 Apr 30 11:14:47 devstack sudo[92228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:47 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-7e3e1b33-1586-413a-885a-53258fd2ee7a (7e3e1b33-1586-413a-885a-53258fd2ee7a): created successfully Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8c9940-6bbe-442c-bc0d-e07abba48c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (a404aced-68bb-44e2-abf8-ecdd91ab9abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-15cb5993-4271-4007-a369-3c3c8c230c21 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:48 devstack sudo[92228]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5f7484b8-8763-4626-a374-c5343a93a926" returned: 0 in 0.651s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "cinder-quobyte-5f7484b8-8763-4626-a374-c5343a93a926" released by "delete_volume" :: held 1.432s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Created reservations ['8a69cfba-abf1-471e-af67-8fab8b343036', '76611da1-571a-4f8e-a790-dad764acb31d', '4b66323c-d1e8-4758-b36e-376ff2662f97', '6eb8a8bc-46f6-4ded-9ac1-12060a460f3b'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:48 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:48 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:48 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e 1073741824" returned: 0 in 0.879s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:48 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e Apr 30 11:14:48 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:49 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.628s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Deleted volume successfully. Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-738e8389-76f7-46bc-956f-8c08e926b71d tempest-VolumesActionsTest-652539150 None] Lock "cinder-5f7484b8-8763-4626-a374-c5343a93a926-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:49 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e" returned: 0 in 0.620s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.690s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830757367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf68d47-0415-47a8-aa5a-1eeef1e2de16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:33Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume 2bf68d47-0415-47a8-aa5a-1eeef1e2de16 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:49 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64acaa76-f056-46f6-8359-99ad098eb29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e29015-c7d9-49b2-a8ad-6c952068e83e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 1073741824 Apr 30 11:14:49 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b727762d-b183-4f3e-9f6a-b24bda8b215f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:49 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-65e29015-c7d9-49b2-a8ad-6c952068e83e (65e29015-c7d9-49b2-a8ad-6c952068e83e): created successfully Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b727762d-b183-4f3e-9f6a-b24bda8b215f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:49 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (3f3f3864-e09c-4599-8b95-40301c23c225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f7d68274-e02d-46d0-9c73-12d0334487f3 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:50 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 1073741824" returned: 0 in 0.871s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:50 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 Apr 30 11:14:50 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:50 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" returned: 0 in 0.754s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.878s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84024331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80caa884-5101-4568-990b-a27775ae9e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:34Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume 80caa884-5101-4568-990b-a27775ae9e4e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:50 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b628ed-065a-4861-87b0-893cb4407532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:50 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e 1073741824 Apr 30 11:14:50 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4c4be-d7f3-45d6-937a-3e0de023abfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:50 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 (2bf68d47-0415-47a8-aa5a-1eeef1e2de16): created successfully Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4c4be-d7f3-45d6-937a-3e0de023abfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:50 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (efd7f622-7fa2-415a-9ebd-5f6bd5eb7571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:50 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b2b440aa-89ba-4c10-8e7d-9f85dabe6ef8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:51 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e 1073741824" returned: 0 in 0.940s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:51 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e Apr 30 11:14:51 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:52 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e" returned: 0 in 0.636s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.137s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128398523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db8d4c6-d15e-4946-94ef-6a950748683d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc57c8873a4f445fa4a89939531d0e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:34Z,use_quota=True,user_id='b5b7bbf6b1ad456dace3e6dbc7db6b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Creating volume 8db8d4c6-d15e-4946-94ef-6a950748683d {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:52 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:52 devstack sudo[92263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d 1073741824 Apr 30 11:14:52 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be33535d-2caa-4d5a-b17e-add3f2237bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80caa884-5101-4568-990b-a27775ae9e4e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368ab979-f36a-4b24-986e-7600cf7c7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-80caa884-5101-4568-990b-a27775ae9e4e (80caa884-5101-4568-990b-a27775ae9e4e): created successfully Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (368ab979-f36a-4b24-986e-7600cf7c7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (0ad0d256-8d3a-41a4-ac50-c0908659c9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-46bf5b74-5a6d-4d10-b2a6-450f7e1a6150 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:53 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d 1073741824" returned: 0 in 0.889s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:53 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d Apr 30 11:14:53 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:54 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d" returned: 0 in 0.676s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 10.072s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (249cf593-0086-4ef1-b84f-f7b76d35b000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db8d4c6-d15e-4946-94ef-6a950748683d', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ccb10a-486d-40f8-9458-178ecb7df14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4283c9-7413-47c4-8bd9-4b18a9cb5d90]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:54 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Volume volume-8db8d4c6-d15e-4946-94ef-6a950748683d (8db8d4c6-d15e-4946-94ef-6a950748683d): created successfully Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ccb10a-486d-40f8-9458-178ecb7df14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Flow 'volume_create_manager' (815a8af9-83bf-46bd-aa4d-a5abb923523e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-48638281-83ab-44d6-86b0-ab85e2398ed2 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created volume successfully. Apr 30 11:14:54 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:54 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:54 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:55 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:55 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-8db8d4c6-d15e-4946-94ef-6a950748683d-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-8db8d4c6-d15e-4946-94ef-6a950748683d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-8db8d4c6-d15e-4946-94ef-6a950748683d" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-8db8d4c6-d15e-4946-94ef-6a950748683d" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db6a3fa-ecef-48a8-b75d-7de422c05f4a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:55 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d Apr 30 11:14:55 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (85884229-51f6-46cd-bcec-3dee218805f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:55 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56851c5b-0197-40df-bc41-92445d2b7055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 1 in 0.962s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 2G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56851c5b-0197-40df-bc41-92445d2b7055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330937780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a77f5a2-214b-4461-bb82-5637fb8e9475,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:56Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96245a5d-d22e-4702-b23c-2d8cb19eadf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96245a5d-d22e-4702-b23c-2d8cb19eadf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab824f-1f41-4b1e-bc0d-98594906c0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ab824f-1f41-4b1e-bc0d-98594906c0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a77f5a2-214b-4461-bb82-5637fb8e9475', 'volume_name': 'volume-4a77f5a2-214b-4461-bb82-5637fb8e9475', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee01985c-f0a3-4c64-af7e-5e56cc8f5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee01985c-f0a3-4c64-af7e-5e56cc8f5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:55 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749addea-7fc3-4db5-8887-561f35e6f442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:56 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Volume 4a77f5a2-214b-4461-bb82-5637fb8e9475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a77f5a2-214b-4461-bb82-5637fb8e9475', 'volume_size': 1} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 2G" returned: 0 in 0.080s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.875s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330937780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a77f5a2-214b-4461-bb82-5637fb8e9475,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:56Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Creating volume 4a77f5a2-214b-4461-bb82-5637fb8e9475 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:56 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:56 devstack sudo[92297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 1073741824 Apr 30 11:14:56 devstack sudo[92297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-275965fa-59c0-43d2-b1d9-d550cca1213e tempest-VolumesExtendTest-1071578354 None] Extend volume completed successfully. Apr 30 11:14:56 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d" returned: 0 in 0.984s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:56 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d Apr 30 11:14:56 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:56 devstack sudo[92297]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 1073741824" returned: 0 in 0.949s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:57 devstack sudo[92308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 Apr 30 11:14:57 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:57 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8db8d4c6-d15e-4946-94ef-6a950748683d" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-8db8d4c6-d15e-4946-94ef-6a950748683d" released by "delete_volume" :: held 1.759s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['15ec81c1-7385-4756-aa44-a2d4afb69103', '88890b6b-bffa-41a5-b5f1-b4690a1a252e', '77991df6-2a2d-4bc2-b990-ec5c95992702', '23c93c1d-ed39-4519-8788-ab009b4516cf'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-04634384-dd9d-415c-bc33-9b2c2fa354a5-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:57 devstack sudo[92310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:57 devstack sudo[92310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-04634384-dd9d-415c-bc33-9b2c2fa354a5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-quobyte-04634384-dd9d-415c-bc33-9b2c2fa354a5" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-04634384-dd9d-415c-bc33-9b2c2fa354a5" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd55cf8a-b42a-4671-a608-7ff997faee2b]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-80caa884-5101-4568-990b-a27775ae9e4e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-80caa884-5101-4568-990b-a27775ae9e4e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-80caa884-5101-4568-990b-a27775ae9e4e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:57 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:57 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-80caa884-5101-4568-990b-a27775ae9e4e" acquired by "delete_volume" :: waited 0.047s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ffc46-9e97-4975-aa09-5d0fc5fba98a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:57 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475" returned: 0 in 0.830s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749addea-7fc3-4db5-8887-561f35e6f442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a77f5a2-214b-4461-bb82-5637fb8e9475', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf45234-7ab0-4e7b-8871-b75d3e72cf7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:57 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Volume volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 (4a77f5a2-214b-4461-bb82-5637fb8e9475): created successfully Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf45234-7ab0-4e7b-8871-b75d3e72cf7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:57 devstack sudo[92315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e Apr 30 11:14:57 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (85884229-51f6-46cd-bcec-3dee218805f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:57 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b73fbee8-e904-4a20-a611-2ebdae1f2fda tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:14:58 devstack sudo[92310]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.864s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:14:58 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d13c4e95-9d16-445c-8374-7ebc217928d8 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-8db8d4c6-d15e-4946-94ef-6a950748683d-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:58 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 0.958s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:58 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:58 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:58 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e" returned: 0 in 0.896s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:58 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e Apr 30 11:14:58 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (184152ab-70fe-480c-815d-31530230d54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276500e7-9791-42ec-8439-328865396d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (276500e7-9791-42ec-8439-328865396d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590355233',display_name='tempest-VolumesGetTest-Volume-2067902944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa297fb-2161-4bde-a97b-580f1af32ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:59Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aac69f5-42a0-482e-8b0e-ecb778a1ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aac69f5-42a0-482e-8b0e-ecb778a1ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcff5250-6eeb-4d21-bdae-0eb8213da367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcff5250-6eeb-4d21-bdae-0eb8213da367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa297fb-2161-4bde-a97b-580f1af32ab9', 'volume_name': 'volume-faa297fb-2161-4bde-a97b-580f1af32ab9', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2576bb24-df03-41fd-bbe9-297391f1baac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2576bb24-df03-41fd-bbe9-297391f1baac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd54ea-32bd-4edd-97e1-65734d54e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:14:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Volume faa297fb-2161-4bde-a97b-580f1af32ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa297fb-2161-4bde-a97b-580f1af32ab9', 'volume_size': 1} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:14:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590355233',display_name='tempest-VolumesGetTest-Volume-2067902944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa297fb-2161-4bde-a97b-580f1af32ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:14:59Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Creating volume faa297fb-2161-4bde-a97b-580f1af32ab9 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:14:58 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:14:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:58 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 1073741824 Apr 30 11:14:58 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:59 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 1 in 0.796s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:59 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5 Apr 30 11:14:59 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:59 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-80caa884-5101-4568-990b-a27775ae9e4e" returned: 0 in 0.729s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-80caa884-5101-4568-990b-a27775ae9e4e" released by "delete_volume" :: held 1.694s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['026d1c5f-4ad9-4eed-abf1-997028a56e17', '019de94d-b3cd-4807-b524-63f01adcd3ae', '21516561-3428-438d-9ab3-169be2279d77', '26099309-a977-4a1e-9eed-88806891bdb2'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:59 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:14:59 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:59 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 1073741824" returned: 0 in 0.893s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:14:59 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 Apr 30 11:14:59 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-2bf68d47-0415-47a8-aa5a-1eeef1e2de16-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:14:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-2bf68d47-0415-47a8-aa5a-1eeef1e2de16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:00 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-04634384-dd9d-415c-bc33-9b2c2fa354a5" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-04634384-dd9d-415c-bc33-9b2c2fa354a5" released by "delete_volume" :: held 2.628s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac098c-81ac-4be1-97d3-de2995c1dd6d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Created reservations ['1020ab17-24ea-48fb-bb6a-3aead6f07b49', 'f37f0903-a0c5-48a4-a8ad-0efb5ebd8206', '4be7e760-7fb7-4e93-9ede-01cc041957d2', '54bd97d6-42dc-48c9-9600-a9287736d205'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:00 devstack sudo[92344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 Apr 30 11:15:00 devstack sudo[92344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:00 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.720s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:00 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:00 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ff67ace9-6d46-475c-a4a7-43446428f5f4 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-80caa884-5101-4568-990b-a27775ae9e4e-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:00 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9" returned: 0 in 0.747s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd54ea-32bd-4edd-97e1-65734d54e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa297fb-2161-4bde-a97b-580f1af32ab9', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eacbec3-9a77-494e-9b54-5015677b8932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:00 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Volume volume-faa297fb-2161-4bde-a97b-580f1af32ab9 (faa297fb-2161-4bde-a97b-580f1af32ab9): created successfully Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eacbec3-9a77-494e-9b54-5015677b8932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:00 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (184152ab-70fe-480c-815d-31530230d54d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-557b1309-39a8-4c8d-8944-a990f961cbd3 tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:01 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.743s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:01 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Deleted volume successfully. Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3cfbc2a1-f1b3-452b-ad56-59247a2d6d78 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-04634384-dd9d-415c-bc33-9b2c2fa354a5-delete_volume" released by "delete_volume" :: held 3.700s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:01 devstack sudo[92344]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" returned: 0 in 0.961s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:01 devstack sudo[92354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16 Apr 30 11:15:01 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-faa297fb-2161-4bde-a97b-580f1af32ab9-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "cinder-faa297fb-2161-4bde-a97b-580f1af32ab9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Flow 'volume_create_manager' (c603b488-c9be-4e58-be9f-4a7c52e9278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2455f4-1d7e-4339-8836-6581861fd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb2455f4-1d7e-4339-8836-6581861fd91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1448354244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7fabb1-f8f5-4b80-98fd-94bd43d7b124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7bc3cb06a4a7588a9b3960ac9976b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:01Z,use_quota=True,user_id='c0976d02ecf44040b5a72e6c26a26c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd22c12b-1a3f-4cd2-b214-ab8f2e457257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd22c12b-1a3f-4cd2-b214-ab8f2e457257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20d26c5-97ee-417f-9b77-45226c27b927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20d26c5-97ee-417f-9b77-45226c27b927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7fabb1-f8f5-4b80-98fd-94bd43d7b124', 'volume_name': 'volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaa1024-04ca-4de7-960a-98ba537b5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eaa1024-04ca-4de7-960a-98ba537b5265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de56aa6a-10ea-4223-b437-882093633a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:01 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Volume 2b7fabb1-f8f5-4b80-98fd-94bd43d7b124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124', 'volume_size': 1} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1448354244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7fabb1-f8f5-4b80-98fd-94bd43d7b124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c7bc3cb06a4a7588a9b3960ac9976b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:01Z,use_quota=True,user_id='c0976d02ecf44040b5a72e6c26a26c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Creating volume 2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:01 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:01 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 1073741824 Apr 30 11:15:01 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-faa297fb-2161-4bde-a97b-580f1af32ab9" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-faa297fb-2161-4bde-a97b-580f1af32ab9" acquired by "delete_volume" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43179958-7f83-445f-a82e-3c96597642d5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:01 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 Apr 30 11:15:01 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:01 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" returned: 0 in 0.737s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-2bf68d47-0415-47a8-aa5a-1eeef1e2de16" released by "delete_volume" :: held 1.750s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['36f33ad1-26d4-47f1-a274-3382f8742cb3', '715503fd-e577-4764-9b73-01a2cbed3b32', '2394aa52-53a0-4b40-bc5d-5d73004ca489', 'afeac164-1d47-4198-996f-f339424384d8'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:01 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:02 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-65e29015-c7d9-49b2-a8ad-6c952068e83e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-65e29015-c7d9-49b2-a8ad-6c952068e83e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:02 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 1073741824" returned: 0 in 1.029s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-65e29015-c7d9-49b2-a8ad-6c952068e83e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-65e29015-c7d9-49b2-a8ad-6c952068e83e" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fae0da0-e975-486c-aea9-1c6a039c0212]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9" returned: 0 in 1.036s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:02 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:02 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:02 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9 Apr 30 11:15:02 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:02 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e Apr 30 11:15:02 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:02 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:02 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:15:02 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4cc57f36-c40f-42cf-aaa3-82b612231c29 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-2bf68d47-0415-47a8-aa5a-1eeef1e2de16-delete_volume" released by "delete_volume" :: held 2.752s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:03 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.659s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de56aa6a-10ea-4223-b437-882093633a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c61cd-8cdb-4b0f-8ba2-c04f836725fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:03 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Volume volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 (2b7fabb1-f8f5-4b80-98fd-94bd43d7b124): created successfully Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012c61cd-8cdb-4b0f-8ba2-c04f836725fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Flow 'volume_create_manager' (c603b488-c9be-4e58-be9f-4a7c52e9278c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-beac056a-5e4d-4906-b656-593fffecf90c tempest-VolumesExtendTest-1071578354 None] Created volume successfully. Apr 30 11:15:03 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-faa297fb-2161-4bde-a97b-580f1af32ab9" returned: 0 in 0.718s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-faa297fb-2161-4bde-a97b-580f1af32ab9" released by "delete_volume" :: held 1.807s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Created reservations ['07fc5e60-c589-416b-88e0-28b5ddf36c40', 'c78a168c-44a3-4f95-aaa0-89a1d9040041', 'a1917ad6-1430-4421-bbc8-1ade645d7d2a', '80659d9d-8581-434f-8a23-3a23fe76ef0b'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:03 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e" returned: 0 in 0.928s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:03 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:03 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:03 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e Apr 30 11:15:03 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-4a77f5a2-214b-4461-bb82-5637fb8e9475-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Creating offline snapshot fab30682-ec84-4bea-a950-58bc8146735a of volume 2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "cinder-4a77f5a2-214b-4461-bb82-5637fb8e9475-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[436bbf09-3466-47a9-af95-ea318b81a92f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-4a77f5a2-214b-4461-bb82-5637fb8e9475" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-4a77f5a2-214b-4461-bb82-5637fb8e9475" acquired by "delete_volume" :: waited 0.037s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[759773d8-f0eb-4640-960f-64c4b048a1d3]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:03 devstack sudo[92390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:03 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:04 devstack sudo[92391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 Apr 30 11:15:04 devstack sudo[92391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:04 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-65e29015-c7d9-49b2-a8ad-6c952068e83e" returned: 0 in 0.804s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-65e29015-c7d9-49b2-a8ad-6c952068e83e" released by "delete_volume" :: held 1.802s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['3daa60e8-b4fd-4653-bfc9-4ecd2cdf3b11', '1cbb3168-26e8-4dba-b884-f42f5112e710', '83fc0fdb-acce-483b-9a8e-48cbae44425b', '8f137a81-7f33-494d-ad64-5dc532259eb7'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:04 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.912s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:04 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c40266eb-5059-4fbc-9ea8-fcb0018b793c tempest-VolumesGetTest-1211486152 None] Lock "cinder-faa297fb-2161-4bde-a97b-580f1af32ab9-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:04 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-7e3e1b33-1586-413a-885a-53258fd2ee7a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-7e3e1b33-1586-413a-885a-53258fd2ee7a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:04 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.963s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a 1G Apr 30 11:15:04 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-7e3e1b33-1586-413a-885a-53258fd2ee7a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-7e3e1b33-1586-413a-885a-53258fd2ee7a" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:04 devstack sudo[92391]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475" returned: 0 in 0.929s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbef150-af51-47e7-8da8-e2532deb6379]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:04 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475 Apr 30 11:15:04 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:05 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a Apr 30 11:15:05 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:05 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.867s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:05 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b7ab1ddd-1002-45fe-90bf-cc620d0b9791 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-65e29015-c7d9-49b2-a8ad-6c952068e83e-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:05 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a 1G" returned: 0 in 0.854s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:05 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a77f5a2-214b-4461-bb82-5637fb8e9475" returned: 0 in 0.789s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:05 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a Apr 30 11:15:05 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-4a77f5a2-214b-4461-bb82-5637fb8e9475" released by "delete_volume" :: held 1.770s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Created reservations ['fa72d18c-1878-4c58-a998-b8b79605d34e', '00bdc672-ae1b-4814-b4cb-1fc8fd42f1fa', 'ad96ecfe-42e4-40ed-994a-d35bd9ac9632', 'a8a5396e-4152-45dd-8eab-e044dc3f81a7'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:05 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a" returned: 0 in 0.918s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:05 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a Apr 30 11:15:05 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:05 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:05 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a" returned: 0 in 0.775s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:06 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a is being set with open permissions: ugo+rw Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:06 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a Apr 30 11:15:06 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (2acb732b-5538-4b0e-bb5f-15c31d5328f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3783a03-9b6b-4f41-a194-f8b03d025518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3783a03-9b6b-4f41-a194-f8b03d025518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-663735148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:06Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9461625-02c5-4f1d-812f-46198db004f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9461625-02c5-4f1d-812f-46198db004f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a102e8c-7fcc-4531-99e4-c8136b2a1f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a102e8c-7fcc-4531-99e4-c8136b2a1f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'volume_name': 'volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a95b42-7cad-4cb4-a4cd-3b58868528f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a95b42-7cad-4cb4-a4cd-3b58868528f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34440d1b-88e2-4414-9cf8-5ddbed614be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:06 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Volume 39ca2d65-30b3-4d20-a2e2-a1fa9c071b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'volume_size': 1} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:06 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-7e3e1b33-1586-413a-885a-53258fd2ee7a" returned: 0 in 0.819s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-7e3e1b33-1586-413a-885a-53258fd2ee7a" released by "delete_volume" :: held 1.796s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:06 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.817s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:06 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['084badd4-f86b-401f-a512-d3279ca1b8b4', 'f7246126-e0f9-4506-ae52-93254466dd46', 'be0a95cf-af75-4c43-975d-e19aca6a9420', 'e943a2a6-c82a-4e5b-8e51-5748245bab2a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e6ef39da-0088-42da-881c-b301da9e7a2f tempest-VolumesGetTest-1211486152 None] Lock "cinder-4a77f5a2-214b-4461-bb82-5637fb8e9475-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:06 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:06 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-fd10cf4b-b45a-4582-9e5b-530d1788e8f4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:07 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:07 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-fd10cf4b-b45a-4582-9e5b-530d1788e8f4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "cinder-quobyte-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef2ee9-9332-4569-877e-6058add331be]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:07 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a" returned: 0 in 0.826s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:07 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info Apr 30 11:15:07 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:07 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 Apr 30 11:15:07 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:07 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.811s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-504fd0f2-db27-45d0-a41d-18671e2fae67 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-7e3e1b33-1586-413a-885a-53258fd2ee7a-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:07 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.844s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:08 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" returned: 0 in 0.875s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:08 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info" returned: 0 in 0.809s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:08 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info is being set with open permissions: ugo+rw Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:08 devstack sudo[92449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4 Apr 30 11:15:08 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:08 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info Apr 30 11:15:08 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:08 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" returned: 0 in 0.654s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-quobyte-fd10cf4b-b45a-4582-9e5b-530d1788e8f4" released by "delete_volume" :: held 1.577s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:08 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.info" returned: 0 in 0.698s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.063s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.202s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-663735148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:06Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Creating volume 39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:08 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:08 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 1073741824 Apr 30 11:15:08 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:08 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Created reservations ['4b534daf-f6b7-4c13-b628-5ea39fc8cc96', '534ecb15-5121-4c35-954e-0fb591d07e80', '13a99915-4da9-4964-b43e-a386ddf3a56d', 'c8e0f277-9cec-486c-8336-f695dfb3c04a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:08 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d1afb2c8-d76b-4de8-9d50-05abb2dde830 tempest-VolumesExtendTest-1071578354 None] Create snapshot completed successfully Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:09 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:09 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:09 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 1073741824" returned: 0 in 0.885s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:09 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.691s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Deleted volume successfully. Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-9bfba40c-d074-4f28-91bf-a5a85b8bf007 tempest-CreateVolumesFromSourceVolumeTest-1620474439 None] Lock "cinder-fd10cf4b-b45a-4582-9e5b-530d1788e8f4-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:09 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:09 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:10 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.717s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.360s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34440d1b-88e2-4414-9cf8-5ddbed614be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b58160-e41f-4e35-a224-a03fbac24207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2bd35-bb76-4e59-9c53-af7fe39355f7]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Volume volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 (39ca2d65-30b3-4d20-a2e2-a1fa9c071b84): created successfully Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b58160-e41f-4e35-a224-a03fbac24207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (2acb732b-5538-4b0e-bb5f-15c31d5328f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-69dd2375-f3ed-437b-bca4-b9c08ae86279 tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:10 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:10 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:11 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.903s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a 2G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (a4887e6d-de59-461e-9fb3-90ec86168172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13fd72a-b7e4-4a20-b1b0-0304dd3ac193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13fd72a-b7e4-4a20-b1b0-0304dd3ac193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-306649866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648681a5-c3dc-45bc-9aea-3cd1b8cef5be,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:11Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f54fee9-7462-4a3c-b681-0fdf2ec04125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f54fee9-7462-4a3c-b681-0fdf2ec04125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a515b-bd54-4438-835a-0d17c0f29fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a 2G" returned: 0 in 0.189s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.156s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a515b-bd54-4438-835a-0d17c0f29fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '648681a5-c3dc-45bc-9aea-3cd1b8cef5be', 'volume_name': 'volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be', 'volume_size': 1, 'source_volid': '39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5118b7c3-f570-4613-8bd2-cc34043c4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5118b7c3-f570-4613-8bd2-cc34043c4393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fde053-5bb5-49f3-bf01-149f61f432a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Volume 648681a5-c3dc-45bc-9aea-3cd1b8cef5be: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be', 'volume_size': 1, 'source_volid': '39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'source_volstatus': 'available'} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:11 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Cloning volume 39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 to volume 648681a5-c3dc-45bc-9aea-3cd1b8cef5be Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Creating offline snapshot 5d788985-9372-419a-8f6d-54e8e3bca919 of volume 39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:15:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-5c261cfd-778f-4a3b-938e-47887a4358a5 tempest-VolumesExtendTest-1071578354 None] Extend volume completed successfully. Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb947485-9511-4d36-a032-4b483b97d36f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:11 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:11 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-fab30682-ec84-4bea-a950-58bc8146735a-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-fab30682-ec84-4bea-a950-58bc8146735a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-quobyte-fab30682-ec84-4bea-a950-58bc8146735a" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-fab30682-ec84-4bea-a950-58bc8146735a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Deleting offline snapshot fab30682-ec84-4bea-a950-58bc8146735a of volume 2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:15:12 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] snapshot_file for this snap is: volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.828s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc3226a-ec27-435d-aa7d-f6992fa07540]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:12 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 1G Apr 30 11:15:12 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:12 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a Apr 30 11:15:12 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:13 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:13 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 1G" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:13 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:13 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b57b777-6aa2-44a3-b4e2-39827f0e7e3e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:13 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:13 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:14 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.689s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 is being set with open permissions: ugo+rw Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:14 devstack sudo[92503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:14 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:14 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.741s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:14 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a Apr 30 11:15:14 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:14 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.632s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:14 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info Apr 30 11:15:14 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:14 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a" returned: 0 in 0.834s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:15 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a Apr 30 11:15:15 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:15 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info" returned: 0 in 0.660s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:15 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info is being set with open permissions: ugo+rw Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:15 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info Apr 30 11:15:15 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:15 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124.fab30682-ec84-4bea-a950-58bc8146735a" returned: 0 in 0.681s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-fab30682-ec84-4bea-a950-58bc8146735a" released by "_delete_snapshot" :: held 3.188s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" released by "delete_snapshot" :: held 3.217s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Created reservations ['0595321c-fff6-47a8-afdc-892a15b12b4e', 'a1bb2708-0bfc-4ea5-b667-1878f59f62db', '92221014-0e9b-47d3-89b4-cf009031981a', 'a39d0c35-b8b8-42c5-aedd-4dfb73206123'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Delete snapshot completed successfully. Apr 30 11:15:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f9030f3f-6b95-487d-b47a-67ed4ea40da1 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-fab30682-ec84-4bea-a950-58bc8146735a-delete_snapshot" released by "delete_snapshot" :: held 3.374s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:15 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.info" returned: 0 in 0.624s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] snapshot: 5d788985-9372-419a-8f6d-54e8e3bca919, volume: 648681a5-c3dc-45bc-9aea-3cd1b8cef5be, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcdd8f5-032a-4986-8560-aeaba6459ea0]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:16 devstack sudo[92520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:16 devstack sudo[92520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:16 devstack sudo[92520]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.779s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab314e-8606-4806-9e89-c0e82348d7b6]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:16 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:16 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7169730d-8f16-452e-8e2b-2879c87e5d0c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:17 devstack sudo[92527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:17 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:17 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.722s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:17 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:15:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:17 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be Apr 30 11:15:17 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:17 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:17 devstack sudo[92537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124 Apr 30 11:15:17 devstack sudo[92537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:18 devstack sudo[92537]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" returned: 0 in 0.642s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-quobyte-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124" released by "delete_volume" :: held 1.500s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Created reservations ['cc517470-c664-4f74-9c1c-ac8b37b36627', 'bfeb3564-da91-4d8f-9171-8c269d3a799e', '6b392397-353f-465c-9b59-af32daedff19', '193a8b64-572f-4b7a-bcc1-be5609177a11'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:18 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:18 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:20 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.422s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:20 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Deleted volume successfully. Apr 30 11:15:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3c516330-074d-45d8-bf2d-2b7da88d1513 tempest-VolumesExtendTest-1071578354 None] Lock "cinder-2b7fabb1-f8f5-4b80-98fd-94bd43d7b124-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:23 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" returned: 0 in 5.655s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0382821-87e3-4572-9085-f89fb454ad83]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:23 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:23 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:24 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.898s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:15:24 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Converted 1024.00 MB image at 181.04 MB/s Apr 30 11:15:24 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be is being set with open permissions: ugo+rw Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:24 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be Apr 30 11:15:24 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=108,cinder:UPDATE=138,cinder:DELETE=10,cinder:INSERT=42 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=134,cinder:SELECT=93,cinder:INSERT=32,cinder:DELETE=13 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Flow 'volume_create_manager' (2b1052ea-5183-46f8-8626-89155beaf495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fe9ff9-c7de-44a7-83d4-41120a635325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fe9ff9-c7de-44a7-83d4-41120a635325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1260429315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96eb2e1ed6e0423baa41cc7956467157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:25Z,use_quota=True,user_id='97f4d4455a184b2dbed7512f25612d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895499b0-7303-4fc3-8788-9992c71de558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (895499b0-7303-4fc3-8788-9992c71de558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d130ef82-a8fb-4141-8a2e-e1255a2d4b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d130ef82-a8fb-4141-8a2e-e1255a2d4b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73', 'volume_name': 'volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94a0a31-3d00-438b-8a7f-9266c5726781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94a0a31-3d00-438b-8a7f-9266c5726781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6fbc4-8e2f-47c8-a863-65b004c097af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73', 'volume_size': 1} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:24 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" returned: 0 in 0.711s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" released by "_copy_volume_from_snapshot" :: held 8.856s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-5d788985-9372-419a-8f6d-54e8e3bca919" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-5d788985-9372-419a-8f6d-54e8e3bca919" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Deleting offline snapshot 5d788985-9372-419a-8f6d-54e8e3bca919 of volume 39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] snapshot_file for this snap is: volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a09057-baae-41fa-98a4-78317340c705]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:25 devstack sudo[92563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:25 devstack sudo[92563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:25 devstack sudo[92563]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.733s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde7c1a3-3212-4569-aed8-7cc2f8074bd5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:25 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:25 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:26 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:26 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:26 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:27 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.790s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:27 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919 Apr 30 11:15:27 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:27 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84.5d788985-9372-419a-8f6d-54e8e3bca919" returned: 0 in 0.588s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-5d788985-9372-419a-8f6d-54e8e3bca919" released by "_delete_snapshot" :: held 2.952s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.236s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.201s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1260429315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96eb2e1ed6e0423baa41cc7956467157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:25Z,use_quota=True,user_id='97f4d4455a184b2dbed7512f25612d1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Creating volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:27 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40fde053-5bb5-49f3-bf01-149f61f432a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be', 'volume_size': 1, 'source_volid': '39ca2d65-30b3-4d20-a2e2-a1fa9c071b84', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:27 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 1073741824 Apr 30 11:15:27 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e805ef9-6d0d-46ca-a79b-a5f7b09d2d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Volume volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be (648681a5-c3dc-45bc-9aea-3cd1b8cef5be): created successfully Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e805ef9-6d0d-46ca-a79b-a5f7b09d2d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (a4887e6d-de59-461e-9fb3-90ec86168172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-69dc431b-a3d4-4078-b6f2-b3e32a7b0b9f tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:28 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 1073741824" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:28 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 Apr 30 11:15:28 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:29 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" returned: 0 in 0.612s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed6fbc4-8e2f-47c8-a863-65b004c097af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac2b97c-00e5-45b7-9f32-6697060fc0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Volume volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 (5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73): created successfully Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ac2b97c-00e5-45b7-9f32-6697060fc0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Flow 'volume_create_manager' (2b1052ea-5183-46f8-8626-89155beaf495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d3b36794-88b7-4357-958c-041aeaa2dee7 tempest-VolumesSnapshotListTestJSON-579211773 None] Created volume successfully. Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (5d395226-c6bf-41d6-a097-4697f4a82378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb3d2d5-21ee-49c2-b690-18bbdc582df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb3d2d5-21ee-49c2-b690-18bbdc582df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-6226521',display_name='tempest-VolumesGetTest-Volume-212868947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c097f7-bb84-4581-9a6e-2f919ca98631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:29Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22adf0a1-d616-45ec-a2cc-91f153f1d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22adf0a1-d616-45ec-a2cc-91f153f1d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e037f1-6569-4ae5-bb88-4d6b0ff5d83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3e037f1-6569-4ae5-bb88-4d6b0ff5d83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9c097f7-bb84-4581-9a6e-2f919ca98631', 'volume_name': 'volume-d9c097f7-bb84-4581-9a6e-2f919ca98631', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccc7d07-89bc-4ec2-be57-14dadcae7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccc7d07-89bc-4ec2-be57-14dadcae7597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9a5984-d45c-4011-8266-fd7932619452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:29 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Volume d9c097f7-bb84-4581-9a6e-2f919ca98631: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9c097f7-bb84-4581-9a6e-2f919ca98631', 'volume_size': 1} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-6226521',display_name='tempest-VolumesGetTest-Volume-212868947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9c097f7-bb84-4581-9a6e-2f919ca98631,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:29Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Creating volume d9c097f7-bb84-4581-9a6e-2f919ca98631 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:29 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:29 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 1073741824 Apr 30 11:15:29 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:30 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 1073741824" returned: 0 in 0.784s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:30 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 Apr 30 11:15:30 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:31 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631" returned: 0 in 0.593s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.944s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9a5984-d45c-4011-8266-fd7932619452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9c097f7-bb84-4581-9a6e-2f919ca98631', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec519c9-33a6-40df-b44d-92fa95fd6275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Creating offline snapshot 257bbf5c-83a3-468f-85d0-24fbd3679fae of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:15:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Volume volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 (d9c097f7-bb84-4581-9a6e-2f919ca98631): created successfully Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec519c9-33a6-40df-b44d-92fa95fd6275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (5d395226-c6bf-41d6-a097-4697f4a82378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b8740-7f30-43a3-ac7b-7548f481860a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-34a9c2e6-cc6d-4c62-949a-059720d2013f tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:31 devstack sudo[92599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 Apr 30 11:15:31 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-d9c097f7-bb84-4581-9a6e-2f919ca98631-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:31 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" returned: 0 in 0.721s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "cinder-d9c097f7-bb84-4581-9a6e-2f919ca98631-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:31 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae 1G Apr 30 11:15:31 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-d9c097f7-bb84-4581-9a6e-2f919ca98631" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-d9c097f7-bb84-4581-9a6e-2f919ca98631" acquired by "delete_volume" :: waited 0.012s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70e5f81-352f-426b-8520-cf87ef01e654]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:32 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 Apr 30 11:15:32 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:32 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae 1G" returned: 0 in 0.788s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:32 devstack sudo[92614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:32 devstack sudo[92614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:32 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631" returned: 0 in 0.731s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:32 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631 Apr 30 11:15:32 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:33 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d9c097f7-bb84-4581-9a6e-2f919ca98631" returned: 0 in 0.588s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:33 devstack sudo[92614]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-d9c097f7-bb84-4581-9a6e-2f919ca98631" released by "delete_volume" :: held 1.361s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.657s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:33 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae is being set with open permissions: ugo+rw Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:33 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:33 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Created reservations ['7ea2d20a-3f27-4876-86b2-2bd55c54bfff', '1c137e04-db9b-489b-826b-0d6153017e00', '0ca4540b-d8fe-4981-a262-8bf814a2ad6b', '3b6c36a0-3653-4a02-9d0e-21323e322537'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:33 devstack sudo[92625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:33 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:33 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.585s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:33 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info Apr 30 11:15:33 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:34 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.636s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ba6a547f-7cd8-48e0-867e-5b921feebd8a tempest-VolumesGetTest-1211486152 None] Lock "cinder-d9c097f7-bb84-4581-9a6e-2f919ca98631-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-648681a5-c3dc-45bc-9aea-3cd1b8cef5be-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "cinder-648681a5-c3dc-45bc-9aea-3cd1b8cef5be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424790f-dddd-4402-930d-ef0bc78fbe32]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:34 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be Apr 30 11:15:34 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:34 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info" returned: 0 in 0.652s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:34 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info is being set with open permissions: ugo+rw Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:34 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info Apr 30 11:15:34 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:34 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" returned: 0 in 0.721s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:35 devstack sudo[92639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be Apr 30 11:15:35 devstack sudo[92639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:35 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.info" returned: 0 in 0.681s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.218s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:35 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-babd6e2a-a630-4f35-9067-3682a086472b tempest-VolumesSnapshotListTestJSON-579211773 None] Create snapshot completed successfully Apr 30 11:15:35 devstack sudo[92639]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" returned: 0 in 0.640s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-648681a5-c3dc-45bc-9aea-3cd1b8cef5be" released by "delete_volume" :: held 1.421s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Created reservations ['c7ba1634-8b11-4eaa-af41-656435c54e76', '62a0960c-fe42-4024-a3cc-323335bfa4bb', '1813e98b-ad4b-43e5-ac3e-7b80e39f38b0', 'a3695379-47bc-49e6-85d8-cc746e64b74a'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:35 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:35 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:36 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.631s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-553d3518-c4c6-46c5-b0a0-21c11488d001 tempest-VolumesGetTest-1211486152 None] Lock "cinder-648681a5-c3dc-45bc-9aea-3cd1b8cef5be-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "cinder-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e6796b-ba9a-42e2-8af4-042878da9e17]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Creating offline snapshot d8c9c514-3d41-476a-b5a9-55e4653f36a3 of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[01739494-437a-4c9b-bdf2-49a3462f7906]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:36 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:36 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:36 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:36 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:37 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.745s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:37 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84 Apr 30 11:15:37 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:37 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.757s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:37 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 1G Apr 30 11:15:37 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:38 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" returned: 0 in 0.654s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84" released by "delete_volume" :: held 1.462s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Created reservations ['efc4e51d-64cf-4174-b7ad-b0e5c96d8a26', 'e9be7b23-616c-48b5-9c61-9ec606bff835', 'bedd5fdc-8b0f-4ecb-8328-b54a9fa7abac', '0889fd53-d3c8-4cb4-b960-6400aaf3b5d9'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:38 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:38 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:38 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 1G" returned: 0 in 0.813s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:38 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:38 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:38 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.652s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-bc294076-548c-49ee-86d4-8ca051fb7918 tempest-VolumesGetTest-1211486152 None] Lock "cinder-39ca2d65-30b3-4d20-a2e2-a1fa9c071b84-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:38 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.712s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:38 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 is being set with open permissions: ugo+rw Apr 30 11:15:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:38 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:39 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (cf731d55-10fd-4dfc-ae2e-10c2942b48ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71b22a-6e8b-44e6-941b-8fe2a650901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f71b22a-6e8b-44e6-941b-8fe2a650901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1724017256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c4c17-94ae-4beb-93bb-3176484fe6f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:39Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe866bea-6c21-4b1d-b390-2bcf3042f548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe866bea-6c21-4b1d-b390-2bcf3042f548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6bea68-8446-4597-8d6a-924a34d7d35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.image.glance [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Creating Keystone auth plugin from conf {{(pid=84206) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 30 11:15:39 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.631s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.031s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ee50ec62-590c-4b76-bea3-b4919194e17a tempest-VolumesSnapshotListTestJSON-579211773 None] Create snapshot completed successfully Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6bea68-8446-4597-8d6a-924a34d7d35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba6c4c17-94ae-4beb-93bb-3176484fe6f4', 'volume_name': 'volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d1efae-7f64-4f72-b1ad-26d64fbd271a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69d1efae-7f64-4f72-b1ad-26d64fbd271a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a3c6bb-395b-421e-a7b2-d6d39a3b56ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:39 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 30 11:15:39 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Trying to clone ba6c4c17-94ae-4beb-93bb-3176484fe6f4 from image 9165766b-a0b9-4919-8d55-0a96e0f54340 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]). {{(pid=84206) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 30 11:15:40 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Image download 20.69 MB at 20.69 MB/s Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8ede3-faaa-448d-b63a-8048fdf10f4d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:40 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD Apr 30 11:15:40 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:40 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 is fetched for user 4de3c287b607448baae271337c047fcd. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Creating offline snapshot d7a49928-7961-4499-8370-053e74870d21 of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[210958bd-b9f1-40a0-8598-56a39dfb464d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3aada91-13f6-4022-8ce0-6721a3d049ac]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:41 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:41 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:41 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD Apr 30 11:15:41 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:41 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD" returned: 0 in 0.670s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:41 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.711s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:41 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 1G Apr 30 11:15:41 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:42 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 1G" returned: 0 in 0.791s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:42 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 Apr 30 11:15:42 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:43 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21" returned: 0 in 0.616s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:43 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 is being set with open permissions: ugo+rw Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:43 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 Apr 30 11:15:43 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:43 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21" returned: 0 in 0.580s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1724017256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba6c4c17-94ae-4beb-93bb-3176484fe6f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:39Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Creating volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:43 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:43 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1073741824 Apr 30 11:15:43 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c421aed5-afae-44ff-8ef2-612d71b13f16 tempest-VolumesSnapshotListTestJSON-579211773 None] Create snapshot completed successfully Apr 30 11:15:44 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1073741824" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:44 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:44 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-d7a49928-7961-4499-8370-053e74870d21-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-d7a49928-7961-4499-8370-053e74870d21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-d7a49928-7961-4499-8370-053e74870d21" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-d7a49928-7961-4499-8370-053e74870d21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Deleting offline snapshot d7a49928-7961-4499-8370-053e74870d21 of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] snapshot_file for this snap is: volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24a3044-32e6-4da1-a05c-b61badc9019e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:45 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 Apr 30 11:15:45 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:45 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 0 in 0.692s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Attempting download of 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d7c8de-f31e-4968-9789-abdf4af01503]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:45 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5 Apr 30 11:15:45 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:45 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21" returned: 0 in 0.768s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4a8643-6996-4d55-b361-05bbf31f0685]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:45 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:45 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:46 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5" returned: 0 in 0.737s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:46 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5 Apr 30 11:15:46 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:46 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.725s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:46 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 Apr 30 11:15:46 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:46 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5" returned: 1 in 0.758s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9165766b-a0b9-4919-8d55-0a96e0f54340_ff1euwu5' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c6b7c0-51dc-4eda-a42a-330392c08219]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:46 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD Apr 30 11:15:46 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:47 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21" returned: 0 in 0.804s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:47 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21 Apr 30 11:15:47 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:47 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD" returned: 0 in 0.743s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] 9165766b-a0b9-4919-8d55-0a96e0f54340 was qcow2, converting to raw {{(pid=84206) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:47 devstack sudo[92783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:47 devstack sudo[92783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:47 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d7a49928-7961-4499-8370-053e74870d21" returned: 0 in 0.620s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-d7a49928-7961-4499-8370-053e74870d21" released by "_delete_snapshot" :: held 3.014s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" released by "delete_snapshot" :: held 3.043s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Created reservations ['0553311d-100c-40fa-a72e-143b8eb21826', '60e28f80-0c02-416a-9bf9-778eb1c511d3', '4345819a-5a32-4860-abe1-e23e1bc10763', '2e0cc752-ef65-44ae-b932-673ea16b1944'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Delete snapshot completed successfully. Apr 30 11:15:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d72e8cc4-fea2-441e-9838-fc5aa1a27c96 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-d7a49928-7961-4499-8370-053e74870d21-delete_snapshot" released by "delete_snapshot" :: held 3.192s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-d8c9c514-3d41-476a-b5a9-55e4653f36a3-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-d8c9c514-3d41-476a-b5a9-55e4653f36a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-d8c9c514-3d41-476a-b5a9-55e4653f36a3" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-d8c9c514-3d41-476a-b5a9-55e4653f36a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Deleting offline snapshot d8c9c514-3d41-476a-b5a9-55e4653f36a3 of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] snapshot_file for this snap is: volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0676be56-7eb6-4984-8116-6f749215b508]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:49 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:49 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:49 devstack sudo[92783]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 0 in 1.848s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9165766b-a0b9-4919-8d55-0a96e0f54340_ujs0klc_devstack@QuobyteHD, size 112.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:15:49 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Converted 112.00 MB image at 60.57 MB/s Apr 30 11:15:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:49 devstack sudo[92796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1G Apr 30 11:15:49 devstack sudo[92796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea7229c-fee6-42d6-a3b4-26a8a9811b19]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[92796]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 1G" returned: 0 in 0.669s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f7d309-a1bc-415e-a109-b466cb8f5a6a]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[92804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:50 devstack sudo[92804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:50 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[92804]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.730s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 0 in 0.693s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:50 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:50 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:50 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:50 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:51 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 1 in 0.720s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Downloaded image 9165766b-a0b9-4919-8d55-0a96e0f54340 ((None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}])) to volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4 successfully. {{(pid=84206) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Temporary image 9165766b-a0b9-4919-8d55-0a96e0f54340 for user 4de3c287b607448baae271337c047fcd is deleted. {{(pid=84206) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.volume_utils [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Marking volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4 as bootable. {{(pid=84206) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Copying metadata from image 9165766b-a0b9-4919-8d55-0a96e0f54340 to ba6c4c17-94ae-4beb-93bb-3176484fe6f4. {{(pid=84206) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Creating volume glance metadata for volume ba6c4c17-94ae-4beb-93bb-3176484fe6f4 backed by image 9165766b-a0b9-4919-8d55-0a96e0f54340 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84206) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 30 11:15:51 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.775s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:51 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3 Apr 30 11:15:51 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a3c6bb-395b-421e-a7b2-d6d39a3b56ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4', 'volume_size': 1, 'image_id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9165766b-a0b9-4919-8d55-0a96e0f54340', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '63534a770ed44a76a0cf66d9c5cb45b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9165766b-a0b9-4919-8d55-0a96e0f54340', 'created_at': datetime.datetime(2026, 4, 30, 9, 0, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 30, 9, 0, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9165766b-a0b9-4919-8d55-0a96e0f54340/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1622761-438a-46aa-b021-740531d72b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:51 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Volume volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 (ba6c4c17-94ae-4beb-93bb-3176484fe6f4): created successfully Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1622761-438a-46aa-b021-740531d72b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:51 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (cf731d55-10fd-4dfc-ae2e-10c2942b48ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c41464df-52e5-4838-8da7-7e98a8eb5f20 tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:52 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.d8c9c514-3d41-476a-b5a9-55e4653f36a3" returned: 0 in 0.608s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-d8c9c514-3d41-476a-b5a9-55e4653f36a3" released by "_delete_snapshot" :: held 3.031s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" released by "delete_snapshot" :: held 3.058s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Created reservations ['10e89aff-0c0c-4cec-a06e-eeea66e7b629', 'bb28ce01-9769-4024-8422-f5d0c4b9a3dd', 'd03507f5-00c3-4404-ad8c-a85d10d86db2', '4b1ac9e5-5ea5-4d6e-87cf-d41834c5ddc7'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Delete snapshot completed successfully. Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f26e417b-5d54-4c1f-90af-c696a21d34f8 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-d8c9c514-3d41-476a-b5a9-55e4653f36a3-delete_snapshot" released by "delete_snapshot" :: held 3.207s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (c1e270c4-080e-41bb-8a27-4e7a661f87b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a47c5d-e918-409a-aa90-203c28384695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a47c5d-e918-409a-aa90-203c28384695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1174615998',display_name='tempest-VolumesGetTest-Volume-545805158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f204eb97-a4c3-437a-8dec-c89e707c4a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:53Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33ca8c2-703b-4061-a108-9994d2273db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33ca8c2-703b-4061-a108-9994d2273db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c63dee1-9456-4ebd-8cdc-cba465d523da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c63dee1-9456-4ebd-8cdc-cba465d523da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f204eb97-a4c3-437a-8dec-c89e707c4a29', 'volume_name': 'volume-f204eb97-a4c3-437a-8dec-c89e707c4a29', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84a6673-15b8-4ed9-8de4-b3b72c7434bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a84a6673-15b8-4ed9-8de4-b3b72c7434bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10393ce3-4f02-419b-b676-91a1fd496105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Volume f204eb97-a4c3-437a-8dec-c89e707c4a29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f204eb97-a4c3-437a-8dec-c89e707c4a29', 'volume_size': 1} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:15:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1174615998',display_name='tempest-VolumesGetTest-Volume-545805158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f204eb97-a4c3-437a-8dec-c89e707c4a29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3f8b91f90b6426a9e9f53ea2e9cc1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:15:53Z,use_quota=True,user_id='4de3c287b607448baae271337c047fcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Creating volume f204eb97-a4c3-437a-8dec-c89e707c4a29 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:15:52 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:15:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:52 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 1073741824 Apr 30 11:15:52 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-257bbf5c-83a3-468f-85d0-24fbd3679fae-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-257bbf5c-83a3-468f-85d0-24fbd3679fae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-257bbf5c-83a3-468f-85d0-24fbd3679fae" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-257bbf5c-83a3-468f-85d0-24fbd3679fae" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Deleting offline snapshot 257bbf5c-83a3-468f-85d0-24fbd3679fae of volume 5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] snapshot_file for this snap is: volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5e990-9fdb-4eed-be19-4b306243950b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:53 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:53 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:53 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 1073741824" returned: 0 in 0.811s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:53 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 Apr 30 11:15:53 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:54 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.776s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f65452d-bb62-4997-92c9-8cc13872228e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:54 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10393ce3-4f02-419b-b676-91a1fd496105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f204eb97-a4c3-437a-8dec-c89e707c4a29', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20ae86d-848d-4f83-84cf-6f613c038426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:15:54 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 Apr 30 11:15:54 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:54 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Volume volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 (f204eb97-a4c3-437a-8dec-c89e707c4a29): created successfully Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20ae86d-848d-4f83-84cf-6f613c038426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:15:54 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Flow 'volume_create_manager' (c1e270c4-080e-41bb-8a27-4e7a661f87b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:15:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-81561768-0d80-4ec9-97e4-db3094830d58 tempest-VolumesGetTest-1211486152 None] Created volume successfully. Apr 30 11:15:55 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-f204eb97-a4c3-437a-8dec-c89e707c4a29-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" returned: 0 in 0.728s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "cinder-f204eb97-a4c3-437a-8dec-c89e707c4a29-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:55 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:55 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-f204eb97-a4c3-437a-8dec-c89e707c4a29" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-f204eb97-a4c3-437a-8dec-c89e707c4a29" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cebf5d-1b17-49a3-9b8b-40e6a7e33a52]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:55 devstack sudo[92849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 Apr 30 11:15:55 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:55 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.707s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:55 devstack sudo[92862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae Apr 30 11:15:55 devstack sudo[92862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:55 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29" returned: 0 in 0.790s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:55 devstack sudo[92867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29 Apr 30 11:15:55 devstack sudo[92867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:56 devstack sudo[92862]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73.257bbf5c-83a3-468f-85d0-24fbd3679fae" returned: 0 in 0.664s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-257bbf5c-83a3-468f-85d0-24fbd3679fae" released by "_delete_snapshot" :: held 2.993s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" released by "delete_snapshot" :: held 3.024s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Created reservations ['ee6fb9a3-7f28-4694-8d9d-1240949b52a8', 'e6d6ace2-c212-4a4f-b296-daff773a5a94', 'e93e3a6f-9c3d-4802-87e6-82d857aec0df', '430cf9a3-1b82-4edb-8fcd-52fea2340b37'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:56 devstack sudo[92867]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-f204eb97-a4c3-437a-8dec-c89e707c4a29" returned: 0 in 0.650s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Delete snapshot completed successfully. Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-f204eb97-a4c3-437a-8dec-c89e707c4a29" released by "delete_volume" :: held 1.480s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b4199417-1c67-47b1-8420-b809cf2e458b tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-257bbf5c-83a3-468f-85d0-24fbd3679fae-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Created reservations ['8fadb4de-339e-41d2-abef-e771d35f37c2', 'de6e2641-6974-422e-b48d-efcd6b7867d6', 'd810499e-e5e0-41e4-b5c0-30ec511fadb6', '36c870ea-f19b-4a3b-90d2-376a33373cf3'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:56 devstack sudo[92871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:56 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4172a6d-32ec-4d80-89e2-8fe2d62274cc]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:56 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 Apr 30 11:15:56 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-ba6c4c17-94ae-4beb-93bb-3176484fe6f4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "cinder-ba6c4c17-94ae-4beb-93bb-3176484fe6f4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:57 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.645s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:57 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Acquiring lock "cinder-quobyte-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a4d7eb89-4de4-4c16-b947-521df5fca9aa tempest-VolumesGetTest-1211486152 None] Lock "cinder-f204eb97-a4c3-437a-8dec-c89e707c4a29-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a0a882-d5bc-45ff-9553-703cd1b4e937]: (4, 'raw') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:57 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" returned: 0 in 0.788s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:57 devstack sudo[92879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:57 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:57 devstack sudo[92881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73 Apr 30 11:15:57 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:58 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 0 in 0.741s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:58 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" returned: 0 in 0.632s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-quobyte-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73" released by "delete_volume" :: held 1.478s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Created reservations ['69407529-02df-4ff1-b336-7a03c1881c04', 'c569ac76-3582-460a-841d-3f510a541bc6', '3b8113e7-8c3d-4f85-96a7-b5cf5dfa6327', 'acc49555-94cc-4b4a-8c31-1ee37f8a77de'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:58 devstack sudo[92886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:58 devstack sudo[92886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:58 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:58 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:59 devstack sudo[92886]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 1 in 0.757s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4' failed. Not Retrying. {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:59 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4 Apr 30 11:15:59 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:15:59 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.690s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:15:59 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Deleted volume successfully. Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cdfef9ed-e4f5-4296-ab89-1d6af959e086 tempest-VolumesSnapshotListTestJSON-579211773 None] Lock "cinder-5c33a41c-da1c-4ed8-a2bc-9c9c5db64c73-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:59 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" returned: 0 in 0.656s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "cinder-quobyte-ba6c4c17-94ae-4beb-93bb-3176484fe6f4" released by "delete_volume" :: held 2.239s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Created reservations ['16efc1be-3a4c-4ba6-8c1e-fc56a85dbac5', '59671643-c576-4b0a-9742-4ffbca05c881', '60a5c2e4-7ef5-4e91-b23f-3ed52ca5ab62', '9707ad38-2e89-425a-a0cc-98fe09cff3d4'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:15:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:15:59 devstack sudo[92898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:15:59 devstack sudo[92898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:00 devstack sudo[92898]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:00 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.648s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:00 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:00 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Deleted volume successfully. Apr 30 11:16:00 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-d092fbb1-6a8a-48d7-9dc7-899549ebdda3 tempest-VolumesGetTest-1211486152 None] Lock "cinder-ba6c4c17-94ae-4beb-93bb-3176484fe6f4-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:01 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Flow 'volume_create_manager' (e0c04592-6c25-4f2a-bc93-f15ec08dd194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:01 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dda8d6a-7819-4af6-8b0b-8e4bff58aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dda8d6a-7819-4af6-8b0b-8e4bff58aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e0270d09a544928aa228a40ed348c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:02Z,use_quota=True,user_id='0922d366190d4140a262a03286b22007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f4c7cf-001a-4a0e-946d-522b820a079f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f4c7cf-001a-4a0e-946d-522b820a079f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb0f0a-ccac-488c-8c2d-da6109da427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6eb0f0a-ccac-488c-8c2d-da6109da427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e', 'volume_name': 'volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8de8aab-6107-4ba8-a911-2fc0d2b6984d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8de8aab-6107-4ba8-a911-2fc0d2b6984d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098bb471-0f0e-4c53-955f-8408a55f9635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:02 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Volume e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e', 'volume_size': 1} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e0270d09a544928aa228a40ed348c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:02Z,use_quota=True,user_id='0922d366190d4140a262a03286b22007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Creating volume e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:16:02 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:02 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e 1073741824 Apr 30 11:16:02 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:02 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e 1073741824" returned: 0 in 0.876s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:02 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:03 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e Apr 30 11:16:03 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (5a848176-ddfb-4aa5-84c9-9d488b15e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4df1bd5-61c6-4254-b61a-94c514c32567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" returned: 0 in 0.625s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4df1bd5-61c6-4254-b61a-94c514c32567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-631427795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d361a9-a68e-46d7-b696-0f68929721e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:04Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b2813-3204-494c-9a71-abfef2f15fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b2813-3204-494c-9a71-abfef2f15fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914fe7ae-2ddf-4369-a16f-8aeef9aeb981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914fe7ae-2ddf-4369-a16f-8aeef9aeb981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d361a9-a68e-46d7-b696-0f68929721e4', 'volume_name': 'volume-03d361a9-a68e-46d7-b696-0f68929721e4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600a3439-e8a5-4cea-8870-349dea3320b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600a3439-e8a5-4cea-8870-349dea3320b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7cd7c-27f8-42bf-95d9-ee924698c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Volume 03d361a9-a68e-46d7-b696-0f68929721e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d361a9-a68e-46d7-b696-0f68929721e4', 'volume_size': 1} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-631427795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d361a9-a68e-46d7-b696-0f68929721e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:04Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Creating volume 03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:16:03 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:03 devstack sudo[92911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 1073741824 Apr 30 11:16:03 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098bb471-0f0e-4c53-955f-8408a55f9635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023dba77-08c7-4b13-bb37-32ddd4bd6e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:03 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Volume volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e (e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e): created successfully Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (023dba77-08c7-4b13-bb37-32ddd4bd6e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:03 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Flow 'volume_create_manager' (e0c04592-6c25-4f2a-bc93-f15ec08dd194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:03 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b9bf7c36-d895-4486-8c8f-9802a30f5344 tempest-CinderUnicodeTest-1737371329 None] Created volume successfully. Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:04 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Flow 'volume_create_manager' (bd91ce29-f544-43a0-9dd6-dbbb021371ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1e7640-cd67-4d24-9877-d43bc0c169bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 1073741824" returned: 0 in 0.958s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc1e7640-cd67-4d24-9877-d43bc0c169bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-575982471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930c856e-762e-4d92-afd6-924d44eba0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e0270d09a544928aa228a40ed348c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:05Z,use_quota=True,user_id='0922d366190d4140a262a03286b22007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796b8920-fd59-46d8-8ca2-54d322aaa221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796b8920-fd59-46d8-8ca2-54d322aaa221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b12ff0a-c671-403e-ad43-abb25e215425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b12ff0a-c671-403e-ad43-abb25e215425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '930c856e-762e-4d92-afd6-924d44eba0ac', 'volume_name': 'volume-930c856e-762e-4d92-afd6-924d44eba0ac', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f522df5-e487-4531-b12c-c6172794eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f522df5-e487-4531-b12c-c6172794eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264ea68-9153-4b1e-af30-c5bd96051026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:04 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Volume 930c856e-762e-4d92-afd6-924d44eba0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-930c856e-762e-4d92-afd6-924d44eba0ac', 'volume_size': 1} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:04 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:04 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:05 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.634s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-575982471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=930c856e-762e-4d92-afd6-924d44eba0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e0270d09a544928aa228a40ed348c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:05Z,use_quota=True,user_id='0922d366190d4140a262a03286b22007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Creating volume 930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:16:05 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7cd7c-27f8-42bf-95d9-ee924698c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d361a9-a68e-46d7-b696-0f68929721e4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:05 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac 1073741824 Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea86ef9d-cdf5-4233-88c7-c517bd5f5190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:05 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:05 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Volume volume-03d361a9-a68e-46d7-b696-0f68929721e4 (03d361a9-a68e-46d7-b696-0f68929721e4): created successfully Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea86ef9d-cdf5-4233-88c7-c517bd5f5190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (5a848176-ddfb-4aa5-84c9-9d488b15e714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:05 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8708fd34-736a-459b-81e2-28e207f91965 tempest-VolumeDependencyTests-1424814196 None] Created volume successfully. Apr 30 11:16:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:06 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac 1073741824" returned: 0 in 0.855s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:06 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac Apr 30 11:16:06 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac" returned: 0 in 0.691s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:16:06 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.019s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:07 devstack sudo[92929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:07 devstack sudo[92929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1264ea68-9153-4b1e-af30-c5bd96051026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-930c856e-762e-4d92-afd6-924d44eba0ac', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a162102-6e85-4a53-a701-b7bb758704f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Creating offline snapshot c10abd80-e383-42e2-b19e-99c2c5d1b92a of volume 03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:16:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Volume volume-930c856e-762e-4d92-afd6-924d44eba0ac (930c856e-762e-4d92-afd6-924d44eba0ac): created successfully Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a162102-6e85-4a53-a701-b7bb758704f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Flow 'volume_create_manager' (bd91ce29-f544-43a0-9dd6-dbbb021371ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68667df-0371-47c3-9fc5-8716899908e4]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-16d1122e-a6e6-49da-bd2f-8202601f9d6a tempest-CinderUnicodeTest-1737371329 None] Created volume successfully. Apr 30 11:16:07 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:07 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:07 devstack sudo[92929]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.636s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:07 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.796s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:07 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a 1G Apr 30 11:16:07 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:08 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a 1G" returned: 0 in 0.799s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d361a9-a68e-46d7-b696-0f68929721e4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:08 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d361a9-a68e-46d7-b696-0f68929721e4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:08 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:09 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03d361a9-a68e-46d7-b696-0f68929721e4 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.709s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:09 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a is being set with open permissions: ugo+rw Apr 30 11:16:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:09 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:09 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:09 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.618s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:10 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info Apr 30 11:16:10 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:10 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info" returned: 0 in 0.628s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:10 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info is being set with open permissions: ugo+rw Apr 30 11:16:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:10 devstack sudo[92954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info Apr 30 11:16:10 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:11 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.info" returned: 0 in 0.620s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.239s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Creating offline snapshot c34be30d-dee6-4678-bd55-1f054cb3fa18 of volume 930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:16:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e6b43d92-f078-4592-a691-b10efd184818 tempest-VolumeDependencyTests-1424814196 None] Create snapshot completed successfully Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab505a1-8ea9-4d4e-ac90-bbdca1868bca]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:11 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac Apr 30 11:16:11 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:12 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac" returned: 0 in 0.714s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:12 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 1G Apr 30 11:16:12 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (9c8a7b66-e092-4b59-ba00-007da2263e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da98ddb9-dcd7-4e09-9c3e-cd91eb99b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da98ddb9-dcd7-4e09-9c3e-cd91eb99b348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1244345122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45bc009-2f99-4688-a55c-095cf56e1dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c10abd80-e383-42e2-b19e-99c2c5d1b92a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:13Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4f6b05-77a8-4b57-8bc2-10358dae0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4f6b05-77a8-4b57-8bc2-10358dae0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6943fa4-88f0-45b7-b1f4-c421739784aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6943fa4-88f0-45b7-b1f4-c421739784aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c45bc009-2f99-4688-a55c-095cf56e1dec', 'volume_name': 'volume-c45bc009-2f99-4688-a55c-095cf56e1dec', 'volume_size': 1, 'snapshot_id': 'c10abd80-e383-42e2-b19e-99c2c5d1b92a'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac5d3dc-826d-484c-83e8-70ded35bf140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac5d3dc-826d-484c-83e8-70ded35bf140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8493d45-4772-4cc2-984a-2d98b328442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:12 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Volume c45bc009-2f99-4688-a55c-095cf56e1dec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c45bc009-2f99-4688-a55c-095cf56e1dec', 'volume_size': 1, 'snapshot_id': 'c10abd80-e383-42e2-b19e-99c2c5d1b92a'} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:12 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 1G" returned: 0 in 0.815s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930c856e-762e-4d92-afd6-924d44eba0ac -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:12 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930c856e-762e-4d92-afd6-924d44eba0ac -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 Apr 30 11:16:12 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:13 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-930c856e-762e-4d92-afd6-924d44eba0ac -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18" returned: 0 in 0.733s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:13 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 is being set with open permissions: ugo+rw Apr 30 11:16:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:13 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 Apr 30 11:16:13 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:14 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18" returned: 0 in 0.640s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:14 devstack sudo[92975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info Apr 30 11:16:14 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:14 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info" returned: 0 in 0.618s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:14 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info is being set with open permissions: ugo+rw Apr 30 11:16:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:14 devstack sudo[92978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info Apr 30 11:16:14 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:15 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.info" returned: 0 in 0.623s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.239s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.722s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a-c45bc009-2f99-4688-a55c-095cf56e1dec" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a-c45bc009-2f99-4688-a55c-095cf56e1dec" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Creating volume c45bc009-2f99-4688-a55c-095cf56e1dec from snapshot c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8932917a-a5ea-4c61-ac2c-8a3ad437218e tempest-CinderUnicodeTest-1737371329 None] Create snapshot completed successfully Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] snapshot: c10abd80-e383-42e2-b19e-99c2c5d1b92a, volume: c45bc009-2f99-4688-a55c-095cf56e1dec, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c83f2-916e-4700-a82d-c2b5bffccf3a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:15 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:15 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:16 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.736s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d361a9-a68e-46d7-b696-0f68929721e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dcd69c-1e5d-44df-bbe9-1c90dc9b18e9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-c34be30d-dee6-4678-bd55-1f054cb3fa18-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-c34be30d-dee6-4678-bd55-1f054cb3fa18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-quobyte-c34be30d-dee6-4678-bd55-1f054cb3fa18" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-c34be30d-dee6-4678-bd55-1f054cb3fa18" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Deleting offline snapshot c34be30d-dee6-4678-bd55-1f054cb3fa18 of volume 930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] snapshot_file for this snap is: volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:16:16 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:16 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd61f24a-98f6-4f2a-905d-3d5d361fbb98]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:16 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 Apr 30 11:16:16 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:17 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:17 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec Apr 30 11:16:17 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:17 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18" returned: 0 in 0.833s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-930c856e-762e-4d92-afd6-924d44eba0ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f52cec-a25b-4434-a348-0d47f7a5e3c2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:17 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac Apr 30 11:16:17 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:18 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac" returned: 0 in 0.965s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:18 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 Apr 30 11:16:18 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:20 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18" returned: 0 in 1.713s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:20 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18 Apr 30 11:16:20 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:21 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac.c34be30d-dee6-4678-bd55-1f054cb3fa18" returned: 0 in 1.306s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-c34be30d-dee6-4678-bd55-1f054cb3fa18" released by "_delete_snapshot" :: held 5.002s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" released by "delete_snapshot" :: held 5.040s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Created reservations ['a4402b57-4c49-4853-86ae-60d070e89e63', '619aa52d-9dbb-4d13-a3e3-4d742d0208f9', '97f4229b-0cd7-469a-bc61-a4d583c92f35', 'b03eb1db-b263-429b-ab62-647a1947da66'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:21 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Delete snapshot completed successfully. Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fa2761ca-3df8-4be8-80a7-3b561dcd9098 tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-c34be30d-dee6-4678-bd55-1f054cb3fa18-delete_snapshot" released by "delete_snapshot" :: held 5.447s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-930c856e-762e-4d92-afd6-924d44eba0ac-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-930c856e-762e-4d92-afd6-924d44eba0ac-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d4a5f-721b-4c65-9c4e-f5547bef0639]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:22 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac Apr 30 11:16:22 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:22 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec" returned: 0 in 5.323s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50d8ad5-ec6e-483b-a234-61af7594337e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:22 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:22 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:23 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac" returned: 0 in 0.822s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:23 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac Apr 30 11:16:23 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:23 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.941s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:16:23 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Converted 1024.00 MB image at 192.15 MB/s Apr 30 11:16:23 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec is being set with open permissions: ugo+rw Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:23 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec Apr 30 11:16:23 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:23 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-930c856e-762e-4d92-afd6-924d44eba0ac" returned: 0 in 0.686s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-930c856e-762e-4d92-afd6-924d44eba0ac" released by "delete_volume" :: held 1.641s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Created reservations ['650fa023-712d-41cb-b0e7-1601f6acf694', '2cd946e3-f9e8-4e72-be84-b51789460406', 'ed485585-3fbe-4788-828e-18508e9ceb7f', 'e2164f12-c164-4c5b-93a8-37e14e62d699'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:23 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:23 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:24 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec" returned: 0 in 0.674s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" released by "_copy_volume_from_snapshot" :: held 8.556s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a-c45bc009-2f99-4688-a55c-095cf56e1dec" released by "_create_volume_from_snapshot" :: held 8.595s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.621s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8493d45-4772-4cc2-984a-2d98b328442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45bc009-2f99-4688-a55c-095cf56e1dec', 'volume_size': 1, 'snapshot_id': 'c10abd80-e383-42e2-b19e-99c2c5d1b92a'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0c9ce4-aad3-4cd0-ae8c-9fc1a522c765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:24 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Volume volume-c45bc009-2f99-4688-a55c-095cf56e1dec (c45bc009-2f99-4688-a55c-095cf56e1dec): created successfully Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db0c9ce4-aad3-4cd0-ae8c-9fc1a522c765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (9c8a7b66-e092-4b59-ba00-007da2263e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-10ef2053-d007-4eac-a52a-7c9fb2e22ee8 tempest-VolumeDependencyTests-1424814196 None] Created volume successfully. Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "cinder-quobyte-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[09692aaa-e8dc-44a5-8233-7f1ab7046da9]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:24 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e Apr 30 11:16:24 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:24 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.642s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Deleted volume successfully. Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-704fdca5-7e40-475a-9dae-3e184ae619ef tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-930c856e-762e-4d92-afd6-924d44eba0ac-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-c10abd80-e383-42e2-b19e-99c2c5d1b92a-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-c10abd80-e383-42e2-b19e-99c2c5d1b92a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Deleting offline snapshot c10abd80-e383-42e2-b19e-99c2c5d1b92a of volume 03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] snapshot_file for this snap is: volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1153a3-741d-4996-a84e-fbe149f9b91a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:24 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:24 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:25 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" returned: 0 in 0.750s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:25 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e Apr 30 11:16:25 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:25 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.755s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03d361a9-a68e-46d7-b696-0f68929721e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15dc4f-cdce-414c-a553-bdb5d9dc359d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:25 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:25 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:25 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" returned: 0 in 0.632s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-quobyte-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e" released by "delete_volume" :: held 1.430s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=98,cinder:UPDATE=114,cinder:INSERT=37,cinder:DELETE=14 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=112,cinder:SELECT=97,cinder:DELETE=7,cinder:INSERT=31 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Created reservations ['6f6435f0-40ae-4cb1-a6ee-6bb6e29063d8', 'd3c70383-4ea7-432e-b4cf-61b7d348100c', 'dc637675-246d-4818-b110-54bf00fc7940', 'f5826e61-5598-4942-95a2-bdc242a87b67'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:25 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:25 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:26 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:26 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:26 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:26 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.589s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:26 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Deleted volume successfully. Apr 30 11:16:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-6cf070b6-c8d9-42e9-9436-966dc8bf345d tempest-CinderUnicodeTest-1737371329 None] Lock "cinder-e3d7dc7d-1b18-4d8a-aa24-f298912bdc0e-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:27 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.757s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:27 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a Apr 30 11:16:27 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:27 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4.c10abd80-e383-42e2-b19e-99c2c5d1b92a" returned: 0 in 0.664s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c10abd80-e383-42e2-b19e-99c2c5d1b92a" released by "_delete_snapshot" :: held 3.042s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" released by "delete_snapshot" :: held 3.068s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Created reservations ['7f372737-9b34-4d10-9d0c-ff1db0776fa9', 'f972d4d4-b9b5-4207-8085-d2d0579703d7', '9bbe1b8b-522d-4283-9e53-33368dd60358', '3b51e2bf-03b3-4e76-8c7c-991f18d33a16'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Delete snapshot completed successfully. Apr 30 11:16:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-508fce95-26f7-4f26-b337-da60f7a0a7f0 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-c10abd80-e383-42e2-b19e-99c2c5d1b92a-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-03d361a9-a68e-46d7-b696-0f68929721e4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-03d361a9-a68e-46d7-b696-0f68929721e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:29 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa760f-8db7-4cef-b17c-6d1af705da78]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:29 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:29 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:29 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.692s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:29 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4 Apr 30 11:16:29 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:30 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-03d361a9-a68e-46d7-b696-0f68929721e4" returned: 0 in 0.602s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-03d361a9-a68e-46d7-b696-0f68929721e4" released by "delete_volume" :: held 1.353s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Created reservations ['ddaa1e5a-37ce-409e-94c7-c02cb4f38627', '4d60cf83-f662-409f-bab5-79f940951f40', '7b2b1389-52a2-44c4-ad6b-7ca284e04fba', '82c4b75d-2ef3-4caa-a00e-887b47ac6fa0'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:30 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:30 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:31 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.596s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Deleted volume successfully. Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-3667864d-39bc-476d-981f-4d0b2c61de71 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-03d361a9-a68e-46d7-b696-0f68929721e4-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (f9e26caf-a438-4112-bfd3-005481bcaf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0543ec53-cbeb-4b61-9036-117f2688f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0543ec53-cbeb-4b61-9036-117f2688f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1150721128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:31Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4b8057-9d34-4dec-a063-f050fc0fa5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c4b8057-9d34-4dec-a063-f050fc0fa5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e540668-f84e-4b1d-89e4-62d649dd4132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e540668-f84e-4b1d-89e4-62d649dd4132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'volume_name': 'volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df78684-c0d3-468b-8f11-050ab1e0130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df78684-c0d3-468b-8f11-050ab1e0130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc11a20-6493-4948-9aa8-80438e64b077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Volume 3321b5b9-ec1f-4ce0-83ac-d3a488252ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'volume_size': 1} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1150721128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:31Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Creating volume 3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:16:31 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:16:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:31 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 1073741824 Apr 30 11:16:31 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:32 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 1073741824" returned: 0 in 0.740s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:32 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:32 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:32 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.643s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc11a20-6493-4948-9aa8-80438e64b077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d12e6f8-d407-4672-8922-794c413dff5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:33 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Volume volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 (3321b5b9-ec1f-4ce0-83ac-d3a488252ef6): created successfully Apr 30 11:16:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d12e6f8-d407-4672-8922-794c413dff5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:33 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (f9e26caf-a438-4112-bfd3-005481bcaf54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:33 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b4644ee8-12f8-43fe-8991-af32a1f2c7e6 tempest-VolumeDependencyTests-1424814196 None] Created volume successfully. Apr 30 11:16:33 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (e8c5ccd8-5fdc-498f-8874-a3f955a4dc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7049fd-32fa-462f-a59e-f489f80472dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7049fd-32fa-462f-a59e-f489f80472dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-838657938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d383a5-d072-49a5-96d2-0ed8d2609500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b789245f74c24f38a31ddcccec8380a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,status='creating',terminated_at=None,updated_at=2026-04-30T09:16:34Z,use_quota=True,user_id='f1aeb8fc7557472c80f5e7d60a1165f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783dc0ac-0f4a-4925-b4a1-5e3bb65b6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783dc0ac-0f4a-4925-b4a1-5e3bb65b6270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2189d0c-22e6-4163-ae36-02b46b657894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2189d0c-22e6-4163-ae36-02b46b657894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '81d383a5-d072-49a5-96d2-0ed8d2609500', 'volume_name': 'volume-81d383a5-d072-49a5-96d2-0ed8d2609500', 'volume_size': 1, 'source_volid': '3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559b9b99-0973-4076-87e8-83d7e34c20d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559b9b99-0973-4076-87e8-83d7e34c20d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f26f25-073e-483e-9eaa-893ffc39de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:34 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Volume 81d383a5-d072-49a5-96d2-0ed8d2609500: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-81d383a5-d072-49a5-96d2-0ed8d2609500', 'volume_size': 1, 'source_volid': '3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'source_volstatus': 'available'} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:34 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Cloning volume 3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 to volume 81d383a5-d072-49a5-96d2-0ed8d2609500 Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Creating offline snapshot 10a24149-06ac-43a4-9308-805af2319530 of volume 3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[86142339-5e73-4d8f-9ff3-c2891e5f020c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:34 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:34 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:34 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.709s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:34 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 1G Apr 30 11:16:34 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:35 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 1G" returned: 0 in 0.747s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:35 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:35 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:36 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.613s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:36 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 is being set with open permissions: ugo+rw Apr 30 11:16:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:36 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:36 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:36 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.576s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:36 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info Apr 30 11:16:36 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:37 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info" returned: 0 in 0.609s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:37 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info is being set with open permissions: ugo+rw Apr 30 11:16:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:37 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info Apr 30 11:16:37 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:38 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.info" returned: 0 in 0.629s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] snapshot: 10a24149-06ac-43a4-9308-805af2319530, volume: 81d383a5-d072-49a5-96d2-0ed8d2609500, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f24bac-98a9-44e5-a284-525afe033213]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:38 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:38 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:38 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.740s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1712a716-7185-4823-ada9-7cee2235e40d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:38 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:38 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:39 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.716s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:39 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:16:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:39 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 Apr 30 11:16:39 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:44 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500" returned: 0 in 4.473s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d84d945-d280-48b7-99ef-70f379b66c35]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:44 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:44 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:44 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.863s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6, size 1024.00 MB, duration 4.47 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:16:44 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Converted 1024.00 MB image at 228.88 MB/s Apr 30 11:16:44 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 is being set with open permissions: ugo+rw Apr 30 11:16:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:44 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 Apr 30 11:16:44 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:45 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500" returned: 0 in 0.586s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" released by "_copy_volume_from_snapshot" :: held 7.455s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-10a24149-06ac-43a4-9308-805af2319530" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-10a24149-06ac-43a4-9308-805af2319530" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Deleting offline snapshot 10a24149-06ac-43a4-9308-805af2319530 of volume 3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] snapshot_file for this snap is: volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a344367a-4a02-42ce-837c-853bfadd8a95]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:45 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:45 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:46 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.747s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:16:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f6a3a-c0f2-4b03-9460-cfa3b5c14de4]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:46 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:46 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:46 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:INSERT=8,cinder:UPDATE=27,cinder:SELECT=16,cinder:DELETE=2 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:16:47 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.731s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:47 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:47 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:47 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.669s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:47 devstack sudo[93200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530 Apr 30 11:16:47 devstack sudo[93200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:48 devstack sudo[93200]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6.10a24149-06ac-43a4-9308-805af2319530" returned: 0 in 0.610s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-10a24149-06ac-43a4-9308-805af2319530" released by "_delete_snapshot" :: held 2.842s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.354s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f26f25-073e-483e-9eaa-893ffc39de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d383a5-d072-49a5-96d2-0ed8d2609500', 'volume_size': 1, 'source_volid': '3321b5b9-ec1f-4ce0-83ac-d3a488252ef6', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff940b60-3867-4614-9c10-50f9a92af8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:16:48 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Volume volume-81d383a5-d072-49a5-96d2-0ed8d2609500 (81d383a5-d072-49a5-96d2-0ed8d2609500): created successfully Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff940b60-3867-4614-9c10-50f9a92af8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:16:48 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Flow 'volume_create_manager' (e8c5ccd8-5fdc-498f-8874-a3f955a4dc36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:16:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-14b7418a-d752-416d-9759-d7161eb50bde tempest-VolumeDependencyTests-1424814196 None] Created volume successfully. Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" acquired by "delete_volume" :: waited 0.014s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fde354-275e-457c-a68b-53373275869d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:49 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:49 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:49 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.696s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:49 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6 Apr 30 11:16:49 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:50 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" returned: 0 in 0.572s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6" released by "delete_volume" :: held 1.322s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Created reservations ['9f97663e-eb1f-46b7-a372-859302e31ffc', 'f9c296f2-9f6f-4326-b155-1d373c2c0747', '417b7436-081c-429d-a9fa-d4f1c793bf56', '07b08081-a262-4948-b795-75f06aae8e20'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:50 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:50 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:51 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.575s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Deleted volume successfully. Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-96332e4a-846a-41bb-b9f7-43641fc59dbf tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-3321b5b9-ec1f-4ce0-83ac-d3a488252ef6-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-81d383a5-d072-49a5-96d2-0ed8d2609500-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-81d383a5-d072-49a5-96d2-0ed8d2609500-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5ff1b8-5c25-451c-8d67-ef9718e509ad]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:51 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 Apr 30 11:16:51 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:52 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500" returned: 0 in 0.708s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:52 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500 Apr 30 11:16:52 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:52 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-81d383a5-d072-49a5-96d2-0ed8d2609500" returned: 0 in 0.597s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-81d383a5-d072-49a5-96d2-0ed8d2609500" released by "delete_volume" :: held 1.341s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Created reservations ['62e0247d-bdc7-44aa-aec0-1450427d3481', 'bddecd71-8774-480f-8e4c-3781299d6e1f', 'ef93f49a-0a5b-4cf5-bf14-bb20e5d83e10', '05642f1a-dca3-4bcb-8d86-1c535d409e14'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:52 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:52 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:53 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.602s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:53 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Deleted volume successfully. Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0fb02604-1af0-4e4e-b7ff-ed41d9eadff9 tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-81d383a5-d072-49a5-96d2-0ed8d2609500-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-c45bc009-2f99-4688-a55c-095cf56e1dec-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-c45bc009-2f99-4688-a55c-095cf56e1dec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21bcfd2-4b31-4e8b-a766-25e85c1dc2ca]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:16:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:53 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec Apr 30 11:16:53 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:54 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec" returned: 0 in 0.703s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:54 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec Apr 30 11:16:54 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:54 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c45bc009-2f99-4688-a55c-095cf56e1dec" returned: 0 in 0.583s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-quobyte-c45bc009-2f99-4688-a55c-095cf56e1dec" released by "delete_volume" :: held 1.326s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:16:54 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Created reservations ['a6b549fa-1b4d-4a08-b5f9-d334c795d63f', '8950d596-f54a-46ce-a3d3-87bbc769c105', '45e674e5-c71c-49ce-bad3-04b16030ca6b', 'c3fa5a94-0c89-4169-8f1f-b11b91dce688'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:16:55 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:16:55 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:16:55 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.615s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:16:55 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Deleted volume successfully. Apr 30 11:16:55 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0561f161-ec8d-42ca-a3ed-1b47d77e3c9f tempest-VolumeDependencyTests-1424814196 None] Lock "cinder-c45bc009-2f99-4688-a55c-095cf56e1dec-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:05 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=37,cinder:INSERT=14,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:17:05 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=28,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=3 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:07 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:07 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (6d6da85a-9184-4714-a370-4387b5208d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9862c835-e09e-4440-8144-aa4f6a29a9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9862c835-e09e-4440-8144-aa4f6a29a9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1752656436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafbc32a-da87-4315-9183-91065f2e7cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:07Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4cb92a-df47-4110-a89b-64f16640c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a4cb92a-df47-4110-a89b-64f16640c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6978c4-d0d0-43bc-965b-0b234632f761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6978c4-d0d0-43bc-965b-0b234632f761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aafbc32a-da87-4315-9183-91065f2e7cdc', 'volume_name': 'volume-aafbc32a-da87-4315-9183-91065f2e7cdc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f6aa25-2a22-4a5e-bab4-a0e96e640e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f6aa25-2a22-4a5e-bab4-a0e96e640e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90621ad5-36f7-4579-acb7-7a600af5a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Volume aafbc32a-da87-4315-9183-91065f2e7cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aafbc32a-da87-4315-9183-91065f2e7cdc', 'volume_size': 1} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1752656436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aafbc32a-da87-4315-9183-91065f2e7cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:07Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Creating volume aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:07 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:07 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc 1073741824 Apr 30 11:17:07 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (3ffd3281-fa24-498f-89e1-5dec1a9840c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95acbda1-1df9-4ff1-a072-517c3b8081dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95acbda1-1df9-4ff1-a072-517c3b8081dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828208727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebe2885-9c18-4d7b-9490-beca0ed8a7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:07Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2031f-f273-4e17-9ae7-8483cdd2fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d2031f-f273-4e17-9ae7-8483cdd2fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2817794c-bb58-481b-a78d-5043b7bd6e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2817794c-bb58-481b-a78d-5043b7bd6e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebe2885-9c18-4d7b-9490-beca0ed8a7fb', 'volume_name': 'volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c79f7c3-b9dd-4934-82dc-446a9d89110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c79f7c3-b9dd-4934-82dc-446a9d89110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b1137d-6597-46d5-9037-716418e7f797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Volume eebe2885-9c18-4d7b-9490-beca0ed8a7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb', 'volume_size': 1} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (b3a54d00-b4fb-4f7b-a8bc-ccfef106b041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c25c24-9832-4a82-9122-c81fdae10aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c25c24-9832-4a82-9122-c81fdae10aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231297728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9365a831-ef04-4657-bab8-2c63029f7f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2278c6-2008-4a13-8b3e-cbe770e90df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2278c6-2008-4a13-8b3e-cbe770e90df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca4d7c0-913a-4395-8789-e4f11143b80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca4d7c0-913a-4395-8789-e4f11143b80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9365a831-ef04-4657-bab8-2c63029f7f0e', 'volume_name': 'volume-9365a831-ef04-4657-bab8-2c63029f7f0e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d7cb1-06ca-4e5b-9e14-22ca60310bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf9d7cb1-06ca-4e5b-9e14-22ca60310bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97ddfde-859e-44a1-858e-e63e57a32eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume 9365a831-ef04-4657-bab8-2c63029f7f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9365a831-ef04-4657-bab8-2c63029f7f0e', 'volume_size': 1} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (e1b71a39-9225-4e15-a9f6-b455d9625555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5829a829-6361-4405-bcf2-845d0136e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5829a829-6361-4405-bcf2-845d0136e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1118141623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb933fad-2a0b-4d67-b677-dc703bd0f2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbee937-ffe0-4f71-aa7c-9a69181514ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fbee937-ffe0-4f71-aa7c-9a69181514ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a669246b-bc66-413a-8153-161154a427ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a669246b-bc66-413a-8153-161154a427ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb933fad-2a0b-4d67-b677-dc703bd0f2a6', 'volume_name': 'volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07ca5fc-8d0e-479d-9f4b-5ca63c306bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07ca5fc-8d0e-479d-9f4b-5ca63c306bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02758a0e-cd78-49d6-adfb-b28f8b2042ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Volume bb933fad-2a0b-4d67-b677-dc703bd0f2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6', 'volume_size': 1} Apr 30 11:17:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:08 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.035s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (35169bff-5fd9-480e-9108-3a8fe66a7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113c12c1-7ee8-454c-a37c-2462c71651ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (113c12c1-7ee8-454c-a37c-2462c71651ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10327054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666ca1e4-bd47-4e9e-b1ac-348cae5a5888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2146fc2a-8e82-4619-bf80-14158914a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2146fc2a-8e82-4619-bf80-14158914a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d6903f-e07d-423b-b544-fa46635a4842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d6903f-e07d-423b-b544-fa46635a4842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '666ca1e4-bd47-4e9e-b1ac-348cae5a5888', 'volume_name': 'volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6621c3a-a60c-469c-a2f4-38d7a02417e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6621c3a-a60c-469c-a2f4-38d7a02417e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ace68bf-c01c-4b78-bf0b-3aeb8e20cf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Volume 666ca1e4-bd47-4e9e-b1ac-348cae5a5888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888', 'volume_size': 1} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:08 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc 1073741824" returned: 0 in 1.270s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:08 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:08 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (99759ce6-2600-46b7-a443-463879726987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdc3b45-f313-4a72-adb3-7b84b2e34e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdc3b45-f313-4a72-adb3-7b84b2e34e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826375213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05e0abf-05ad-4c9c-a745-9dd0a5392dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:09Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a262364-b86b-418f-ac49-15fcb46db167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a262364-b86b-418f-ac49-15fcb46db167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94b91c2-6403-47f6-aa56-9c82fc97ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94b91c2-6403-47f6-aa56-9c82fc97ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd05e0abf-05ad-4c9c-a745-9dd0a5392dce', 'volume_name': 'volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55672b86-d7c7-4a7d-afd9-ac7d41031f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55672b86-d7c7-4a7d-afd9-ac7d41031f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609f681c-52a0-430d-a77d-97beed1101ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:08 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Volume d05e0abf-05ad-4c9c-a745-9dd0a5392dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce', 'volume_size': 1} Apr 30 11:17:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (4a197574-927d-4e25-985f-49f3820757aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9d0ba4-d871-4622-b6dc-2431967b264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9d0ba4-d871-4622-b6dc-2431967b264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608162810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:09Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f352bb1f-87d0-4418-94e7-884f44142f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f352bb1f-87d0-4418-94e7-884f44142f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9deb91-aa03-42d8-830b-567fc377e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f9deb91-aa03-42d8-830b-567fc377e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1', 'volume_name': 'volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b97d63-55c5-4426-8056-320f1f13cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b97d63-55c5-4426-8056-320f1f13cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aef9f66-ff76-4a8e-af72-398e83810245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Volume 09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1', 'volume_size': 1} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:09 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.819s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.881s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-828208727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebe2885-9c18-4d7b-9490-beca0ed8a7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:07Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Creating volume eebe2885-9c18-4d7b-9490-beca0ed8a7fb {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:09 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:09 devstack sudo[93303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb 1073741824 Apr 30 11:17:09 devstack sudo[93303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90621ad5-36f7-4579-acb7-7a600af5a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aafbc32a-da87-4315-9183-91065f2e7cdc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e84ed06-c795-47fa-9807-62e17d9341de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:09 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Volume volume-aafbc32a-da87-4315-9183-91065f2e7cdc (aafbc32a-da87-4315-9183-91065f2e7cdc): created successfully Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e84ed06-c795-47fa-9807-62e17d9341de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:09 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (6d6da85a-9184-4714-a370-4387b5208d50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a9f9aff4-f7ff-4c5b-93a5-ec17eadc34ec tempest-VolumeDependencyTests-1184143737 None] Created volume successfully. Apr 30 11:17:10 devstack sudo[93303]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb 1073741824" returned: 0 in 1.023s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:10 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb Apr 30 11:17:10 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:11 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" returned: 0 in 0.633s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.482s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-231297728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9365a831-ef04-4657-bab8-2c63029f7f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume 9365a831-ef04-4657-bab8-2c63029f7f0e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:11 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:11 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e 1073741824 Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b1137d-6597-46d5-9037-716418e7f797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:11 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf2b4dd-1f22-4e09-9919-7bf2dcd512ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Volume volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb (eebe2885-9c18-4d7b-9490-beca0ed8a7fb): created successfully Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf2b4dd-1f22-4e09-9919-7bf2dcd512ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (3ffd3281-fa24-498f-89e1-5dec1a9840c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b17116c5-94be-42c0-af64-4d2f6da0a031 tempest-CreateVolumesFromImageTest-1642181086 None] Created volume successfully. Apr 30 11:17:12 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e 1073741824" returned: 0 in 0.967s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:12 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e Apr 30 11:17:12 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:13 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e" returned: 0 in 0.684s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.041s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1118141623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb933fad-2a0b-4d67-b677-dc703bd0f2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Creating volume bb933fad-2a0b-4d67-b677-dc703bd0f2a6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:13 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97ddfde-859e-44a1-858e-e63e57a32eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9365a831-ef04-4657-bab8-2c63029f7f0e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:13 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 1073741824 Apr 30 11:17:13 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1cfe95-07e7-4cdd-a385-ef89a50d8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:13 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-9365a831-ef04-4657-bab8-2c63029f7f0e (9365a831-ef04-4657-bab8-2c63029f7f0e): created successfully Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1cfe95-07e7-4cdd-a385-ef89a50d8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (b3a54d00-b4fb-4f7b-a8bc-ccfef106b041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f9d0f051-86c8-416f-b247-1c132b5d9408 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:14 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 1073741824" returned: 0 in 0.986s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:14 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 Apr 30 11:17:14 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (8e10c355-7976-4f61-b985-04552e5b6691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a91255-2cd0-40fc-b654-92a61d8c7791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a91255-2cd0-40fc-b654-92a61d8c7791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113067306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bd1464-7b16-421b-a87d-1d47369d805e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cba4e19-42cd-4d23-bac6-9ed2fa922b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cba4e19-42cd-4d23-bac6-9ed2fa922b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97f06dd-58c7-4b2b-8f68-997b161e319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97f06dd-58c7-4b2b-8f68-997b161e319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70bd1464-7b16-421b-a87d-1d47369d805e', 'volume_name': 'volume-70bd1464-7b16-421b-a87d-1d47369d805e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a232c3-f7be-4c97-80a8-3575f19f047f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a232c3-f7be-4c97-80a8-3575f19f047f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98947008-aba0-49b8-b162-8650ff4bfad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume 70bd1464-7b16-421b-a87d-1d47369d805e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70bd1464-7b16-421b-a87d-1d47369d805e', 'volume_size': 1} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:14 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.336s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-10327054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666ca1e4-bd47-4e9e-b1ac-348cae5a5888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:08Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Creating volume 666ca1e4-bd47-4e9e-b1ac-348cae5a5888 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:14 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:14 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 1073741824 Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02758a0e-cd78-49d6-adfb-b28f8b2042ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa448f0-4a4c-4f24-b3f8-1d059deb295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:14 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Volume volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 (bb933fad-2a0b-4d67-b677-dc703bd0f2a6): created successfully Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa448f0-4a4c-4f24-b3f8-1d059deb295d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:14 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (e1b71a39-9225-4e15-a9f6-b455d9625555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:15 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-71ccd526-2587-420f-b6d5-efefb171dcc9 tempest-CreateVolumesFromImageTest-1642181086 None] Created volume successfully. Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (b0accdd5-d92c-470b-b6b0-f3dbdcdbdea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82cba2b-de3d-42ad-a4ec-def62da44c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82cba2b-de3d-42ad-a4ec-def62da44c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835736166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce4df04-e5db-4be5-aeb7-5997b6870d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e5f2c-de93-480f-acb8-c59370ae7598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78e5f2c-de93-480f-acb8-c59370ae7598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c893cf-4daf-48c6-bfa5-1b9f57f6f82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c893cf-4daf-48c6-bfa5-1b9f57f6f82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce4df04-e5db-4be5-aeb7-5997b6870d5a', 'volume_name': 'volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5159b2-5631-4591-b373-0f5ad7e7a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5159b2-5631-4591-b373-0f5ad7e7a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41a847b-3bdb-4f2a-9715-fc90be3443a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume 0ce4df04-e5db-4be5-aeb7-5997b6870d5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a', 'volume_size': 1} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (fde19817-b045-4100-a015-acaaad403cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592b8a29-06e6-4ff5-82bd-4fd7d197b817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (592b8a29-06e6-4ff5-82bd-4fd7d197b817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-722542952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3754bb-bbb9-4c06-8905-9a9e10b20091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02959102-6684-4b1c-bf2c-b210ec3052b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02959102-6684-4b1c-bf2c-b210ec3052b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36274b1-7dca-416c-a19d-4b0ca9b9d35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36274b1-7dca-416c-a19d-4b0ca9b9d35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3754bb-bbb9-4c06-8905-9a9e10b20091', 'volume_name': 'volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa91b483-1d80-451b-b897-eee5f45ea5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa91b483-1d80-451b-b897-eee5f45ea5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c17301d-a17a-42ac-939e-2478e192e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume 4a3754bb-bbb9-4c06-8905-9a9e10b20091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091', 'volume_size': 1} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (6cbf5993-ac57-41f2-b196-6e45e73d88e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13523f3b-ad94-4b2d-aafa-8a6ac00a1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13523f3b-ad94-4b2d-aafa-8a6ac00a1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805727575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f09dba-5a22-4466-8157-0ac1ef0140e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:16Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841270df-076f-4dc6-81e9-6e4cc31ac860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841270df-076f-4dc6-81e9-6e4cc31ac860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:15 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c688e8e6-1559-4836-a3bc-c58f5ed83e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c688e8e6-1559-4836-a3bc-c58f5ed83e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1f09dba-5a22-4466-8157-0ac1ef0140e4', 'volume_name': 'volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7992a8-7149-4747-85b5-4f97820457b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7992a8-7149-4747-85b5-4f97820457b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c5f945-f523-4515-8c44-5a07aae5b4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume d1f09dba-5a22-4466-8157-0ac1ef0140e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4', 'volume_size': 1} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:16 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 1073741824" returned: 0 in 1.202s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:16 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 Apr 30 11:17:16 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (069c6eed-397c-46c1-b90e-591054f1d091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca1881-72a7-485a-b5df-4b25cc6c49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ca1881-72a7-485a-b5df-4b25cc6c49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1635676922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8666a29a-d815-4ada-bc34-1ab6c35a0fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:16Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf1237-8630-421b-92e3-1dd757c5f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf1237-8630-421b-92e3-1dd757c5f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f045ed-d5d4-4e39-8b07-9211d0c49e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f045ed-d5d4-4e39-8b07-9211d0c49e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8666a29a-d815-4ada-bc34-1ab6c35a0fb7', 'volume_name': 'volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17817b21-88ef-405a-8c2c-332768afcef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17817b21-88ef-405a-8c2c-332768afcef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcd0baa-9003-4cd0-b4fd-c6436b098cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume 8666a29a-d815-4ada-bc34-1ab6c35a0fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7', 'volume_size': 1} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:16 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" returned: 0 in 0.803s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.018s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826375213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05e0abf-05ad-4c9c-a745-9dd0a5392dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:09Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Creating volume d05e0abf-05ad-4c9c-a745-9dd0a5392dce {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:16 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:16 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce 1073741824 Apr 30 11:17:16 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ace68bf-c01c-4b78-bf0b-3aeb8e20cf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67608132-2c49-499b-ba29-7516a7e6740f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:16 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Volume volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 (666ca1e4-bd47-4e9e-b1ac-348cae5a5888): created successfully Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67608132-2c49-499b-ba29-7516a7e6740f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:16 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (35169bff-5fd9-480e-9108-3a8fe66a7279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:17 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ae87fc93-0504-4fec-b16f-c5e1175fa66c tempest-CreateVolumesFromImageTest-1642181086 None] Created volume successfully. Apr 30 11:17:17 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce 1073741824" returned: 0 in 0.888s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:17 devstack sudo[93345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce Apr 30 11:17:17 devstack sudo[93345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:18 devstack sudo[93345]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" returned: 0 in 0.699s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.290s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608162810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed5b5e56f9941e1ba12229b1195a255',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:09Z,use_quota=True,user_id='6d783a6cc16e4dffa36bf426a68ea93c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Creating volume 09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:18 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609f681c-52a0-430d-a77d-97beed1101ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:18 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 1073741824 Apr 30 11:17:18 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad051dd-d05b-450a-9910-5ed499505a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:18 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Volume volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce (d05e0abf-05ad-4c9c-a745-9dd0a5392dce): created successfully Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad051dd-d05b-450a-9910-5ed499505a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:18 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (99759ce6-2600-46b7-a443-463879726987) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:18 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a29b8c50-3690-4b25-97c0-ac4c5cffe865 tempest-CreateVolumesFromImageTest-1642181086 None] Created volume successfully. Apr 30 11:17:19 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 1073741824" returned: 0 in 0.943s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:19 devstack sudo[93356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 Apr 30 11:17:19 devstack sudo[93356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:20 devstack sudo[93356]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" returned: 0 in 0.706s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.635s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aef9f66-ff76-4a8e-af72-398e83810245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7294ec12-34f1-4d49-ba8c-7ba23b6cb133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Creating offline snapshot 862b890f-749a-49aa-a9d1-a7437dff3368 of volume aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:17:20 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Volume volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 (09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1): created successfully Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7294ec12-34f1-4d49-ba8c-7ba23b6cb133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Flow 'volume_create_manager' (4a197574-927d-4e25-985f-49f3820757aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c24cb40-4175-418d-923d-3aa9a15344d5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:20 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-6078d86c-42f3-4fe8-ae6b-0ac842efcfde tempest-CreateVolumesFromImageTest-1642181086 None] Created volume successfully. Apr 30 11:17:20 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:20 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:21 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.821s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:21 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 1G Apr 30 11:17:21 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-quobyte-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bea8a6-3bed-4e99-9a39-0818e120ff20]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:21 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 Apr 30 11:17:21 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:22 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 1G" returned: 0 in 1.106s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafbc32a-da87-4315-9183-91065f2e7cdc -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:22 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafbc32a-da87-4315-9183-91065f2e7cdc -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:22 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:22 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" returned: 0 in 0.892s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:22 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1 Apr 30 11:17:22 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:23 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aafbc32a-da87-4315-9183-91065f2e7cdc -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.787s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:23 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 is being set with open permissions: ugo+rw Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:23 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:23 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:23 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" returned: 0 in 0.677s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1" released by "delete_volume" :: held 1.672s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Created reservations ['9e0e5962-6d4f-41a0-8094-08bfb6aa798d', 'bd0dba6b-94aa-4682-bed5-aa2533461582', 'a5633744-abcb-4300-aa13-cd6b267bfa4c', 'e4a947eb-61e1-4aa3-abd9-7d2e7c492fb5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:23 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:23 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-d05e0abf-05ad-4c9c-a745-9dd0a5392dce-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-d05e0abf-05ad-4c9c-a745-9dd0a5392dce-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-quobyte-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[62571e08-424b-4cea-930f-fa5a35084f89]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:23 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.927s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:24 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce Apr 30 11:17:24 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:24 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info Apr 30 11:17:24 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:24 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.814s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:24 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Deleted volume successfully. Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0e6c32cb-e924-451b-b7df-538fda7220d6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-09ef4658-16eb-42ae-bfcb-1e6fb6d76eb1-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:24 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:24 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info is being set with open permissions: ugo+rw Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:24 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" returned: 0 in 0.928s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:24 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info Apr 30 11:17:24 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:24 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce Apr 30 11:17:24 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:25 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.info" returned: 0 in 0.901s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.435s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.937s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-113067306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70bd1464-7b16-421b-a87d-1d47369d805e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume 70bd1464-7b16-421b-a87d-1d47369d805e {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:25 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:25 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-3189b40c-77d9-4afd-bf11-1a78982efad7 tempest-VolumeDependencyTests-1184143737 None] Create snapshot completed successfully Apr 30 11:17:25 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e 1073741824 Apr 30 11:17:25 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:25 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" returned: 0 in 1.003s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-d05e0abf-05ad-4c9c-a745-9dd0a5392dce" released by "delete_volume" :: held 2.002s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Created reservations ['603d7ce0-1895-4448-b426-bb724d63bf3a', '83f1b2df-42bc-48a5-8d5c-ece832fbacb6', 'b3265b76-3d93-4ffd-8ed3-94abb1848c2f', '6bd0b0ef-3703-4f5e-993f-b8a2468c98e6'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:26 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:26 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-666ca1e4-bd47-4e9e-b1ac-348cae5a5888-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-666ca1e4-bd47-4e9e-b1ac-348cae5a5888-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-quobyte-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" acquired by "delete_volume" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d67133-010f-4b1e-90a5-b3e519f34786]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:26 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 Apr 30 11:17:26 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:26 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e 1073741824" returned: 0 in 1.231s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:27 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.049s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:27 devstack sudo[93416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e Apr 30 11:17:27 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Deleted volume successfully. Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-19d67a92-50de-4baf-bf97-d7fbd34c5069 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-d05e0abf-05ad-4c9c-a745-9dd0a5392dce-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (e976ce27-9581-4f33-ba0c-a5831141426b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef05c6-3d63-4515-832b-3f2285dac1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcef05c6-3d63-4515-832b-3f2285dac1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1382588063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5bbce3-719b-47f6-a6e3-019788867085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=862b890f-749a-49aa-a9d1-a7437dff3368,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:27Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e87a056-8eff-42dc-96ef-1cb0d97ab5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e87a056-8eff-42dc-96ef-1cb0d97ab5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d73d84-2846-4512-8181-f5b26949ee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d73d84-2846-4512-8181-f5b26949ee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e5bbce3-719b-47f6-a6e3-019788867085', 'volume_name': 'volume-5e5bbce3-719b-47f6-a6e3-019788867085', 'volume_size': 1, 'snapshot_id': '862b890f-749a-49aa-a9d1-a7437dff3368'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de64e0f8-7af5-4ec3-839c-3e4c02deab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de64e0f8-7af5-4ec3-839c-3e4c02deab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e68e4ca-5076-47b7-9827-47e1fab77c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Volume 5e5bbce3-719b-47f6-a6e3-019788867085: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e5bbce3-719b-47f6-a6e3-019788867085', 'volume_size': 1, 'snapshot_id': '862b890f-749a-49aa-a9d1-a7437dff3368'} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:27 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" returned: 0 in 1.389s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:27 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888 Apr 30 11:17:27 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:27 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e" returned: 0 in 0.726s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.620s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1835736166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce4df04-e5db-4be5-aeb7-5997b6870d5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume 0ce4df04-e5db-4be5-aeb7-5997b6870d5a {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:27 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98947008-aba0-49b8-b162-8650ff4bfad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70bd1464-7b16-421b-a87d-1d47369d805e', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a 1073741824 Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3a9d0c-7aea-48b4-a55a-a0223c6b552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:27 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:27 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-70bd1464-7b16-421b-a87d-1d47369d805e (70bd1464-7b16-421b-a87d-1d47369d805e): created successfully Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f3a9d0c-7aea-48b4-a55a-a0223c6b552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:27 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (8e10c355-7976-4f61-b985-04552e5b6691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:27 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9deeba8f-5b0e-497d-8c1c-12e6ddbd9cce tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:28 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" returned: 0 in 0.699s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-666ca1e4-bd47-4e9e-b1ac-348cae5a5888" released by "delete_volume" :: held 2.162s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Created reservations ['d2f101f2-9bd1-49ba-a212-ee93ded354c3', 'bdfad112-c48c-4c56-a4cd-425c32beec16', '964d166a-8e5f-4e3b-aeae-5997bccbcc7a', '6e9762e3-1eb9-4770-a305-8d0347b8ed43'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:28 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:28 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:28 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a 1073741824" returned: 0 in 1.034s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:28 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a Apr 30 11:17:28 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:29 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.831s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Deleted volume successfully. Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e4f1f857-fea7-4fa2-8704-7bd3f26912bc tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-666ca1e4-bd47-4e9e-b1ac-348cae5a5888-delete_volume" released by "delete_volume" :: held 3.299s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-bb933fad-2a0b-4d67-b677-dc703bd0f2a6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:29 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" returned: 0 in 0.758s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.017s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-722542952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3754bb-bbb9-4c06-8905-9a9e10b20091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:15Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume 4a3754bb-bbb9-4c06-8905-9a9e10b20091 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:29 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-bb933fad-2a0b-4d67-b677-dc703bd0f2a6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:29 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 1073741824 Apr 30 11:17:29 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a41a847b-3bdb-4f2a-9715-fc90be3443a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272d7a5-c63d-4c73-bf5e-597eb1ff00fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:29 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a (0ce4df04-e5db-4be5-aeb7-5997b6870d5a): created successfully Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b272d7a5-c63d-4c73-bf5e-597eb1ff00fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (b0accdd5-d92c-470b-b6b0-f3dbdcdbdea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:29 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b3efe341-454b-4d5d-9761-aaf181b7d6a2 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-quobyte-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c421f0-14b4-4a40-9454-7d4eb0e462b2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:29 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 Apr 30 11:17:29 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Flow 'volume_create_manager' (bf6fda18-b950-4e7e-9009-4d3aab8f3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136197bc-c619-4378-8599-79ea73364938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136197bc-c619-4378-8599-79ea73364938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-161890456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57206ec9-81f9-4566-bf94-131ad9dbb4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052c8947c83e40f9b9c8073a873f2ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:30Z,use_quota=True,user_id='9f7a8b7ca26c4c1f90c0ba8a5acfee53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb301f2-5f60-4bf5-a57f-598bba659ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb301f2-5f60-4bf5-a57f-598bba659ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1888e370-0132-4336-a4e2-6a7d4f95af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1888e370-0132-4336-a4e2-6a7d4f95af75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57206ec9-81f9-4566-bf94-131ad9dbb4fa', 'volume_name': 'volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:30 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432a4493-a92c-4569-a5b8-bf464f786613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:30 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432a4493-a92c-4569-a5b8-bf464f786613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5935b57e-41db-43c5-9ed9-efcf9ebb0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:30 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Volume 57206ec9-81f9-4566-bf94-131ad9dbb4fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa', 'volume_size': 1} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 1073741824" returned: 0 in 0.973s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" returned: 0 in 0.810s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:30 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6 Apr 30 11:17:30 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:30 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 Apr 30 11:17:30 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:31 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091" returned: 0 in 0.621s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.233s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1805727575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1f09dba-5a22-4466-8157-0ac1ef0140e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:16Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume d1f09dba-5a22-4466-8157-0ac1ef0140e4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:31 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:31 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:31 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 1073741824 Apr 30 11:17:31 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c17301d-a17a-42ac-939e-2478e192e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31abb023-13a9-4cf5-a5ec-43b410f93594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" returned: 0 in 0.727s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-bb933fad-2a0b-4d67-b677-dc703bd0f2a6" released by "delete_volume" :: held 1.598s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 (4a3754bb-bbb9-4c06-8905-9a9e10b20091): created successfully Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31abb023-13a9-4cf5-a5ec-43b410f93594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (fde19817-b045-4100-a015-acaaad403cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-9fb79f40-a514-4557-ad7c-247cba0386f9 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Created reservations ['72428d75-6cf0-400c-b728-0bc03a1d0c5d', '05646d52-c615-456d-8bd8-bbaac906afe4', 'bd6d9843-759c-45a8-a5f4-08044c6305da', 'c0552bf7-5ce0-45e2-a8c6-8f5e3d01fcae'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:31 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:31 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-eebe2885-9c18-4d7b-9490-beca0ed8a7fb-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-eebe2885-9c18-4d7b-9490-beca0ed8a7fb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "cinder-quobyte-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ffd4a-aa34-4afc-9a93-3c74e209d16c]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:32 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb Apr 30 11:17:32 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:32 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 1073741824" returned: 0 in 0.903s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:32 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.688s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Deleted volume successfully. Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ee6773dc-7023-4647-b698-98c5b0b8b2f6 tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-bb933fad-2a0b-4d67-b677-dc703bd0f2a6-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:32 devstack sudo[93467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 Apr 30 11:17:32 devstack sudo[93467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:32 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" returned: 0 in 0.771s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:32 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb Apr 30 11:17:32 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:32 devstack sudo[93467]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4" returned: 0 in 0.674s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.464s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1635676922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8666a29a-d815-4ada-bc34-1ab6c35a0fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73851d31ab2d47f3a84eb85fc9962b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:16Z,use_quota=True,user_id='321fe8ed772b4b2085ad1a52dc3bcdbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Creating volume 8666a29a-d815-4ada-bc34-1ab6c35a0fb7 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:32 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c5f945-f523-4515-8c44-5a07aae5b4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cfd73-9c28-4fbc-9bee-25f5e879be26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:32 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 1073741824 Apr 30 11:17:32 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:32 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 (d1f09dba-5a22-4466-8157-0ac1ef0140e4): created successfully Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc8cfd73-9c28-4fbc-9bee-25f5e879be26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:32 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (6cbf5993-ac57-41f2-b196-6e45e73d88e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:32 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4e681cda-5177-4991-9342-675d1048de3e tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:33 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" returned: 0 in 0.646s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-quobyte-eebe2885-9c18-4d7b-9490-beca0ed8a7fb" released by "delete_volume" :: held 1.464s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Created reservations ['a62a67b5-2a36-465b-93b8-0e004f6aa8f6', 'cc325f7a-a35d-40f3-9c04-695078f228d9', '78ed710b-fcc3-403b-8063-3f7f56f7aaf3', 'cf6f0896-6458-41d6-8474-fe7ba2685c78'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:33 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:33 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:33 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 1073741824" returned: 0 in 0.880s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:33 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 Apr 30 11:17:33 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:34 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.638s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Deleted volume successfully. Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-67020b1f-e3cc-49e2-9ddc-c7242c2ddd2a tempest-CreateVolumesFromImageTest-1642181086 None] Lock "cinder-eebe2885-9c18-4d7b-9490-beca0ed8a7fb-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:34 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" returned: 0 in 0.700s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.166s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368-5e5bbce3-719b-47f6-a6e3-019788867085" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcd0baa-9003-4cd0-b4fd-c6436b098cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3f35d6-74da-4687-bb73-dfca8cdaa070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368-5e5bbce3-719b-47f6-a6e3-019788867085" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Creating volume 5e5bbce3-719b-47f6-a6e3-019788867085 from snapshot 862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:34 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Volume volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 (8666a29a-d815-4ada-bc34-1ab6c35a0fb7): created successfully Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3f35d6-74da-4687-bb73-dfca8cdaa070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Flow 'volume_create_manager' (069c6eed-397c-46c1-b90e-591054f1d091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] snapshot: 862b890f-749a-49aa-a9d1-a7437dff3368, volume: 5e5bbce3-719b-47f6-a6e3-019788867085, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:17:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-69c231c9-8fad-41f5-ad7e-40b7a4cb7539 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created volume successfully. Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925856a-f9cc-415e-81c3-bf76f34c3716]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:34 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:34 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-8666a29a-d815-4ada-bc34-1ab6c35a0fb7-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-8666a29a-d815-4ada-bc34-1ab6c35a0fb7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" acquired by "delete_volume" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19852e02-1fd0-4842-941d-27ee7d8a7730]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:35 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 Apr 30 11:17:35 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:35 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.786s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafbc32a-da87-4315-9183-91065f2e7cdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb5926-4e79-4795-8df2-2296f03f9fad]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:35 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:35 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:36 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" returned: 0 in 0.821s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:36 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7 Apr 30 11:17:36 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:36 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.809s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:36 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 Apr 30 11:17:36 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:36 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" returned: 0 in 0.656s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-8666a29a-d815-4ada-bc34-1ab6c35a0fb7" released by "delete_volume" :: held 1.526s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['9bf9c86f-cbc1-4045-b38a-5cedd5728136', '902f5552-19bf-4b5b-a10e-ce5c8783d11d', '05a91563-1eec-4f2e-98af-54b1a69f2ec9', '9b744ed5-6380-4e47-9f89-28b1b5761517'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:36 devstack sudo[93508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:36 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (6f0a5b24-d9aa-446d-99b1-b2a16201424c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a30ad-b94f-4663-ad12-c310805c18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9a30ad-b94f-4663-ad12-c310805c18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800101574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651d4c4a-c4cd-4495-96c7-69509d5f52b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:37Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970bdaa4-2c90-4333-9195-54c15a86d776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970bdaa4-2c90-4333-9195-54c15a86d776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee4c58-416a-489f-a21a-6a27b2640f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cee4c58-416a-489f-a21a-6a27b2640f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651d4c4a-c4cd-4495-96c7-69509d5f52b2', 'volume_name': 'volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b52718-c712-4d43-9ec1-ef1d1559f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b52718-c712-4d43-9ec1-ef1d1559f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a9c7ca-d64d-4939-99b5-be22e82909b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume 651d4c4a-c4cd-4495-96c7-69509d5f52b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2', 'volume_size': 1} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-d1f09dba-5a22-4466-8157-0ac1ef0140e4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-d1f09dba-5a22-4466-8157-0ac1ef0140e4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-d1f09dba-5a22-4466-8157-0ac1ef0140e4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-d1f09dba-5a22-4466-8157-0ac1ef0140e4" acquired by "delete_volume" :: waited 0.040s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bc2ba0-4e26-4c4a-a5ee-1cbbfc8fc52d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:37 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.048s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:37 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:37 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fdc15fe4-26d0-460a-8ecc-d85191a203dd tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-8666a29a-d815-4ada-bc34-1ab6c35a0fb7-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:38 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 Apr 30 11:17:38 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:39 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4" returned: 0 in 1.583s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:39 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4 Apr 30 11:17:39 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:40 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-d1f09dba-5a22-4466-8157-0ac1ef0140e4" returned: 0 in 1.251s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-d1f09dba-5a22-4466-8157-0ac1ef0140e4" released by "delete_volume" :: held 2.947s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['1da699eb-9ad7-4f92-98fc-e43d21cf5112', '99b65250-98c2-4a7b-817d-0c63614d55ae', '76ccc770-36dd-4fc8-af0a-503478a98859', '0ace66c1-e631-45e2-8626-1e19a074ab75'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:41 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:41 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-4a3754bb-bbb9-4c06-8905-9a9e10b20091-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-4a3754bb-bbb9-4c06-8905-9a9e10b20091-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-4a3754bb-bbb9-4c06-8905-9a9e10b20091" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-4a3754bb-bbb9-4c06-8905-9a9e10b20091" acquired by "delete_volume" :: waited 0.046s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dccfc4b-7529-4604-9780-e2575aaef872]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:41 devstack sudo[93534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 Apr 30 11:17:41 devstack sudo[93534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:41 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.014s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:42 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-72e7e730-9e8e-4627-9c0c-09b714c6d2fe tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-d1f09dba-5a22-4466-8157-0ac1ef0140e4-delete_volume" released by "delete_volume" :: held 4.391s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:42 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085" returned: 0 in 5.849s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d6b26a-b558-4932-8ea0-b071f3131402]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:42 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:42 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:42 devstack sudo[93534]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091" returned: 0 in 1.090s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:42 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091 Apr 30 11:17:42 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:43 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.873s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:17:43 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Converted 1024.00 MB image at 175.03 MB/s Apr 30 11:17:43 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 is being set with open permissions: ugo+rw Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:43 devstack sudo[93547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 Apr 30 11:17:43 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:43 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4a3754bb-bbb9-4c06-8905-9a9e10b20091" returned: 0 in 0.646s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-4a3754bb-bbb9-4c06-8905-9a9e10b20091" released by "delete_volume" :: held 1.838s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['a2186fe4-c691-4307-9993-f26644bb93cb', '9a608ceb-2f77-4194-8241-f53302d145ba', '7e3568f6-3109-4472-8309-29b0224bfadf', 'e15281d7-58de-4572-b91c-8b3fdde2c0bf'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:43 devstack sudo[93550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:43 devstack sudo[93550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-0ce4df04-e5db-4be5-aeb7-5997b6870d5a-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-0ce4df04-e5db-4be5-aeb7-5997b6870d5a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[46609530-a4bb-44ea-ae15-fdbc04dc8ee8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:43 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085" returned: 0 in 0.629s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" released by "_copy_volume_from_snapshot" :: held 9.097s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368-5e5bbce3-719b-47f6-a6e3-019788867085" released by "_create_volume_from_snapshot" :: held 9.159s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.200s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.193s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-161890456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57206ec9-81f9-4566-bf94-131ad9dbb4fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052c8947c83e40f9b9c8073a873f2ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:30Z,use_quota=True,user_id='9f7a8b7ca26c4c1f90c0ba8a5acfee53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Creating volume 57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:43 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:43 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa 1073741824 Apr 30 11:17:43 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:43 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e68e4ca-5076-47b7-9827-47e1fab77c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5bbce3-719b-47f6-a6e3-019788867085', 'volume_size': 1, 'snapshot_id': '862b890f-749a-49aa-a9d1-a7437dff3368'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:43 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c20b88-3cd6-4d17-b283-2358d9dfe232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:43 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Volume volume-5e5bbce3-719b-47f6-a6e3-019788867085 (5e5bbce3-719b-47f6-a6e3-019788867085): created successfully Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c20b88-3cd6-4d17-b283-2358d9dfe232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:43 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (e976ce27-9581-4f33-ba0c-a5831141426b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:43 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c9aee44e-5421-4f9c-b23c-475fdd848e3b tempest-VolumeDependencyTests-1184143737 None] Created volume successfully. Apr 30 11:17:44 devstack sudo[93550]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.730s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:44 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7130f398-d8b5-4ec0-aafd-0e584e1e09e0 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-4a3754bb-bbb9-4c06-8905-9a9e10b20091-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:44 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" returned: 0 in 0.825s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:44 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a Apr 30 11:17:44 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:44 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa 1073741824" returned: 0 in 0.817s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-862b890f-749a-49aa-a9d1-a7437dff3368-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:44 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:17:44 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-862b890f-749a-49aa-a9d1-a7437dff3368-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Deleting offline snapshot 862b890f-749a-49aa-a9d1-a7437dff3368 of volume aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] snapshot_file for this snap is: volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5d770c-1cd6-479b-97c7-74cfbcab36b5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:44 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:44 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:45 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" returned: 0 in 0.717s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-0ce4df04-e5db-4be5-aeb7-5997b6870d5a" released by "delete_volume" :: held 1.596s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['651e2008-9278-464a-bf4f-9467b2d98bee', 'c54c7ead-e0fe-4a6b-a1ee-07393bac8e7d', 'f4edccd2-559f-42e6-99dc-0348a3b8d969', 'e947f44d-1aa1-4a26-8269-913026a9dd99'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:45 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.692s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.732s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-800101574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651d4c4a-c4cd-4495-96c7-69509d5f52b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:37Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume 651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:45 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5935b57e-41db-43c5-9ed9-efcf9ebb0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:45 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 1073741824 Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb7eab1-5d1b-4a0d-95e1-400794deaf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:45 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:45 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Volume volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa (57206ec9-81f9-4566-bf94-131ad9dbb4fa): created successfully Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bb7eab1-5d1b-4a0d-95e1-400794deaf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Flow 'volume_create_manager' (bf6fda18-b950-4e7e-9009-4d3aab8f3536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:45 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-662e369b-6236-447c-beae-174be45afd13 tempest-SnapshotDependencyTests-1750591080 None] Created volume successfully. Apr 30 11:17:45 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:45 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:45 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.804s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aafbc32a-da87-4315-9183-91065f2e7cdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcd3a20-f5b2-4612-a3b4-1da11c01934b]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:45 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:45 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-70bd1464-7b16-421b-a87d-1d47369d805e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-70bd1464-7b16-421b-a87d-1d47369d805e-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-70bd1464-7b16-421b-a87d-1d47369d805e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-70bd1464-7b16-421b-a87d-1d47369d805e" acquired by "delete_volume" :: waited 0.038s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bee656-e72c-4264-82fb-bcc7f9b67151]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:46 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.988s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:46 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e Apr 30 11:17:46 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-268cc5b3-e08e-4ca9-9336-e42fe393f30c tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-0ce4df04-e5db-4be5-aeb7-5997b6870d5a-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:46 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 1073741824" returned: 0 in 1.205s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:46 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.982s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:46 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 Apr 30 11:17:46 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:46 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:46 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:47 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e" returned: 0 in 0.787s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:47 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e Apr 30 11:17:47 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:47 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2" returned: 0 in 0.688s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a9c7ca-d64d-4939-99b5-be22e82909b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb9a5f7-3354-4050-9c63-8943ae7ede89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Creating offline snapshot 285c6bf5-6dad-4c8c-93c8-aefe73d65285 of volume 57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:17:47 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 (651d4c4a-c4cd-4495-96c7-69509d5f52b2): created successfully Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb9a5f7-3354-4050-9c63-8943ae7ede89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (6f0a5b24-d9aa-446d-99b1-b2a16201424c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8070a83-cf42-495a-8948-9de1aa0253a0]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:47 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-11253395-0190-4f42-8576-727de869cf10 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:17:47 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.902s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:47 devstack sudo[93642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:17:47 devstack sudo[93642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:47 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368 Apr 30 11:17:47 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:47 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-70bd1464-7b16-421b-a87d-1d47369d805e" returned: 0 in 0.704s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-70bd1464-7b16-421b-a87d-1d47369d805e" released by "delete_volume" :: held 1.545s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['583a101c-acc8-4465-a69c-d2d700acae03', '02c99df1-c4cf-44d0-94d3-50da41dac7d0', '0294debe-d019-4ed1-bea5-1f0afe07091e', '352ba670-bc9c-46e3-afa3-a36101e1bad6'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:47 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:47 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:48 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc.862b890f-749a-49aa-a9d1-a7437dff3368" returned: 0 in 0.654s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:48 devstack sudo[93642]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-862b890f-749a-49aa-a9d1-a7437dff3368" released by "_delete_snapshot" :: held 3.472s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.836s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" released by "delete_snapshot" :: held 3.508s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:48 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 1G Apr 30 11:17:48 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Created reservations ['5e282a1e-e78a-4a28-889e-b01993de2a67', '0f507dc2-8c6e-4f21-8f2e-36c5bcef43db', 'f32506b6-80fc-4ad8-944e-05be03434039', '2c6cb9fc-1b9b-41a8-9e5e-80cbbe99cba5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Delete snapshot completed successfully. Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-4f9fd7d5-7904-48c1-aeab-216318841706 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-862b890f-749a-49aa-a9d1-a7437dff3368-delete_snapshot" released by "delete_snapshot" :: held 3.717s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-9365a831-ef04-4657-bab8-2c63029f7f0e-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-9365a831-ef04-4657-bab8-2c63029f7f0e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "cinder-quobyte-9365a831-ef04-4657-bab8-2c63029f7f0e" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-9365a831-ef04-4657-bab8-2c63029f7f0e" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:48 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.710s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbe8bf4-1f24-4977-8a6a-01f323999176]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:48 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-e3510a89-c76e-4817-bb82-7390b63301c7 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-70bd1464-7b16-421b-a87d-1d47369d805e-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:48 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e Apr 30 11:17:48 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-aafbc32a-da87-4315-9183-91065f2e7cdc-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-aafbc32a-da87-4315-9183-91065f2e7cdc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e92a32-5af9-4617-8a79-c2feef07bc2d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:49 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 1G" returned: 0 in 0.976s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:49 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:17:49 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:49 devstack sudo[93665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:49 devstack sudo[93665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:49 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e" returned: 0 in 0.846s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:49 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e Apr 30 11:17:49 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:49 devstack sudo[93665]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.718s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:49 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.689s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:49 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 is being set with open permissions: ugo+rw Apr 30 11:17:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:49 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc Apr 30 11:17:49 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:49 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:17:49 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:50 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-9365a831-ef04-4657-bab8-2c63029f7f0e" returned: 0 in 0.664s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-quobyte-9365a831-ef04-4657-bab8-2c63029f7f0e" released by "delete_volume" :: held 1.583s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Created reservations ['363bc7a4-d278-489d-8995-0d55aa0fc102', '5f879aa1-22d0-4a7f-84f0-997f4fb8e5ae', 'fe8e42da-d489-421b-94e0-5d02e84719d5', '5c0c6879-033f-4eba-a867-d7182095fb79'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:50 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:50 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:50 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-aafbc32a-da87-4315-9183-91065f2e7cdc" returned: 0 in 0.608s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-aafbc32a-da87-4315-9183-91065f2e7cdc" released by "delete_volume" :: held 1.385s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Created reservations ['facdf94d-0987-468f-a93d-92cd90f1a33c', '05c1710c-27b5-495b-9b7c-454cb32b7a76', 'cd1eff0a-b849-47c9-8849-4e2c09ae9d26', '87d687cd-eb16-4edc-bc0f-b653ecbd2b1f'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:17:50 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.700s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:50 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:17:50 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:50 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info Apr 30 11:17:50 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:51 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.678s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Deleted volume successfully. Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-0cf45257-eb8b-4d63-918e-e559327ad418 tempest-CreateVolumesFromSourceVolumeTest-1461953155 None] Lock "cinder-9365a831-ef04-4657-bab8-2c63029f7f0e-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:51 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.735s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:17:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Deleted volume successfully. Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-98b0bf5d-6409-4182-b493-5e36129049f5 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-aafbc32a-da87-4315-9183-91065f2e7cdc-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:17:51 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info" returned: 0 in 0.793s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:51 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info is being set with open permissions: ugo+rw Apr 30 11:17:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:51 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info Apr 30 11:17:51 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (8db33eb2-5ec1-4035-b0a5-596f1f271796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabc2c18-ee12-4fa4-953d-6cb541a0127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fabc2c18-ee12-4fa4-953d-6cb541a0127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1663073432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ca219b-292d-4a13-818c-0c9505bffc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:52Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc64d470-ec94-4b2f-94c6-1fe8b10986de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc64d470-ec94-4b2f-94c6-1fe8b10986de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1245f2ae-1f3a-4034-9b5e-bbbf15eecf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1245f2ae-1f3a-4034-9b5e-bbbf15eecf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18ca219b-292d-4a13-818c-0c9505bffc20', 'volume_name': 'volume-18ca219b-292d-4a13-818c-0c9505bffc20', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b240e16-8c70-48b0-9a7c-454768548157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b240e16-8c70-48b0-9a7c-454768548157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163d063e-c1d5-44c9-a5ef-c43ab3281f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:52 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Volume 18ca219b-292d-4a13-818c-0c9505bffc20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18ca219b-292d-4a13-818c-0c9505bffc20', 'volume_size': 1} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:52 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.info" returned: 0 in 0.747s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.937s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.494s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating offline snapshot 0ad20c99-c23b-4500-bf89-e96125941e79 of volume 651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c791afc9-2348-4143-89d4-a493f665f8df]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:52 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-af03fb2a-2d54-449b-af9d-bf87a8b65b13 tempest-SnapshotDependencyTests-1750591080 None] Create snapshot completed successfully Apr 30 11:17:52 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 Apr 30 11:17:52 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:53 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2" returned: 0 in 0.766s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:53 devstack sudo[93704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 1G Apr 30 11:17:53 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Flow 'volume_create_manager' (75efbcc8-c461-4148-a0eb-34abff603878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bd5449-6e59-4423-937e-88cb9b06dbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bd5449-6e59-4423-937e-88cb9b06dbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6af6c3a-0f17-473c-af71-07fcb88a2b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='052c8947c83e40f9b9c8073a873f2ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=285c6bf5-6dad-4c8c-93c8-aefe73d65285,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:53Z,use_quota=True,user_id='9f7a8b7ca26c4c1f90c0ba8a5acfee53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f35da3-dfc1-41f5-b1b4-68b8b0c01c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f35da3-dfc1-41f5-b1b4-68b8b0c01c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196e3c9-e75c-4e0e-b637-aebfbadae769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196e3c9-e75c-4e0e-b637-aebfbadae769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e6af6c3a-0f17-473c-af71-07fcb88a2b28', 'volume_name': 'volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28', 'volume_size': 1, 'snapshot_id': '285c6bf5-6dad-4c8c-93c8-aefe73d65285'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015b9dac-4ae8-46e4-9a32-e1329176ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (015b9dac-4ae8-46e4-9a32-e1329176ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62ebda7-6d60-4b29-9873-218958bfd11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:53 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Volume e6af6c3a-0f17-473c-af71-07fcb88a2b28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28', 'volume_size': 1, 'snapshot_id': '285c6bf5-6dad-4c8c-93c8-aefe73d65285'} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:53 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 1G" returned: 0 in 0.767s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:53 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 Apr 30 11:17:53 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:54 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79" returned: 0 in 0.647s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:54 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 is being set with open permissions: ugo+rw Apr 30 11:17:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:54 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 Apr 30 11:17:54 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:55 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79" returned: 0 in 0.585s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:55 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info Apr 30 11:17:55 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:55 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info" returned: 0 in 0.580s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:55 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info is being set with open permissions: ugo+rw Apr 30 11:17:55 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:55 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info Apr 30 11:17:55 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:56 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.info" returned: 0 in 0.604s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.038s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.144s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1663073432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18ca219b-292d-4a13-818c-0c9505bffc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:52Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Creating volume 18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:56 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:17:56 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:56 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 1073741824 Apr 30 11:17:56 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:56 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-937374f7-2be7-4f0c-b86b-daf98d95c074 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Create snapshot completed successfully Apr 30 11:17:57 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 1073741824" returned: 0 in 0.771s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:57 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:17:57 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (4e5c34d9-6cdc-4e1d-9dd7-743c57dbbf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab32df50-8b00-433d-93c8-42da9ea21b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab32df50-8b00-433d-93c8-42da9ea21b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000467256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d83ba22-fab2-463e-b43c-06a51130cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:57Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d06fa-1867-4ff5-aef2-939a86d9785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5d06fa-1867-4ff5-aef2-939a86d9785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c49765-8e23-4188-a2a6-beeffaff367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c49765-8e23-4188-a2a6-beeffaff367c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d83ba22-fab2-463e-b43c-06a51130cecc', 'volume_name': 'volume-4d83ba22-fab2-463e-b43c-06a51130cecc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18b28dd-048e-4a15-9616-14b6c6829fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18b28dd-048e-4a15-9616-14b6c6829fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4695a706-e798-402f-b101-a950790507ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume 4d83ba22-fab2-463e-b43c-06a51130cecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d83ba22-fab2-463e-b43c-06a51130cecc', 'volume_size': 1} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:57 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.638s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.549s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285-e6af6c3a-0f17-473c-af71-07fcb88a2b28" by "_create_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163d063e-c1d5-44c9-a5ef-c43ab3281f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18ca219b-292d-4a13-818c-0c9505bffc20', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfe2f9f-e861-4008-a749-e38ec0e9374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285-e6af6c3a-0f17-473c-af71-07fcb88a2b28" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Creating volume e6af6c3a-0f17-473c-af71-07fcb88a2b28 from snapshot 285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:17:57 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Volume volume-18ca219b-292d-4a13-818c-0c9505bffc20 (18ca219b-292d-4a13-818c-0c9505bffc20): created successfully Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfe2f9f-e861-4008-a749-e38ec0e9374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (8db33eb2-5ec1-4035-b0a5-596f1f271796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] snapshot: 285c6bf5-6dad-4c8c-93c8-aefe73d65285, volume: e6af6c3a-0f17-473c-af71-07fcb88a2b28, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:17:57 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c298ade7-d616-40f6-8053-94a104b017bf tempest-VolumeDependencyTests-1184143737 None] Created volume successfully. Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (c7aeaa8a-d5af-4a3c-b983-122721f4aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca8ee8-8220-4e33-a6f1-a909541628d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[43111f81-d6bc-4d76-bce9-2e21af0b8fd5]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2ca8ee8-8220-4e33-a6f1-a909541628d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153697258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069eb78d-3d21-4b7a-89f6-a09dd446dad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:58Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefee700-7ed5-448a-b4cd-647117aeb2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aefee700-7ed5-448a-b4cd-647117aeb2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41fd7ce-dc0b-4174-8634-c737c5b8907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41fd7ce-dc0b-4174-8634-c737c5b8907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '069eb78d-3d21-4b7a-89f6-a09dd446dad4', 'volume_name': 'volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:57 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ea48d7-c714-4398-a235-c5e9b10f0de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46ea48d7-c714-4398-a235-c5e9b10f0de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e668b6-fb29-4b28-ac47-afc9025fbf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume 069eb78d-3d21-4b7a-89f6-a09dd446dad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4', 'volume_size': 1} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:58 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:17:58 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (2da6924b-0cfa-4fe3-812f-9fd841a0c337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ebc34-47ea-4aa2-869d-d013741554ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5ebc34-47ea-4aa2-869d-d013741554ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1233160611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71177078-ac97-4352-b001-791e4c0cc088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:58Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef73d3ab-7e4c-46dd-8a91-0ab3ee9261a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef73d3ab-7e4c-46dd-8a91-0ab3ee9261a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d38da-4d55-4bea-89e0-073f6fb7c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98d38da-4d55-4bea-89e0-073f6fb7c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71177078-ac97-4352-b001-791e4c0cc088', 'volume_name': 'volume-71177078-ac97-4352-b001-791e4c0cc088', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4e88be-ab36-4532-b97c-fdfd2f70e7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4e88be-ab36-4532-b97c-fdfd2f70e7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7250c6e-1cba-46fa-b1c4-21856cb2f9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume 71177078-ac97-4352-b001-791e4c0cc088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71177078-ac97-4352-b001-791e4c0cc088', 'volume_size': 1} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (e2dc0e18-84cf-4ec1-bebd-79f3ec9c102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a48a6a7-8a19-4712-a18f-af6ba115c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a48a6a7-8a19-4712-a18f-af6ba115c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599492293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c9d127-8d34-40e2-bf09-06768c8ce019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:59Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846f0e0-063c-4fbe-913c-564181991dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7846f0e0-063c-4fbe-913c-564181991dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d6f64-4683-4d64-83b0-2abb1ccd72d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d6f64-4683-4d64-83b0-2abb1ccd72d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c9d127-8d34-40e2-bf09-06768c8ce019', 'volume_name': 'volume-57c9d127-8d34-40e2-bf09-06768c8ce019', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6b9d57-6698-45ad-b4c9-a06639150a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd6b9d57-6698-45ad-b4c9-a06639150a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666d9ee2-97d4-459b-85d4-af01a81acda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:58 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume 57c9d127-8d34-40e2-bf09-06768c8ce019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c9d127-8d34-40e2-bf09-06768c8ce019', 'volume_size': 1} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:58 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.865s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a226d0-e048-4ebf-a962-fa45528245a6]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:17:58 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:58 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:17:58 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (aeb5ab37-0dce-4527-b335-80715edc788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0ea4b2-0882-4c39-ac87-f5e3f87dcc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b0ea4b2-0882-4c39-ac87-f5e3f87dcc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602411791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0faf248-95a2-48ea-846c-2dd8b34cf9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:59Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42379ad8-11f6-4768-a83d-afcbcf2aaa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42379ad8-11f6-4768-a83d-afcbcf2aaa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859751a-1f89-498b-9b7a-b93bf9f7d5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859751a-1f89-498b-9b7a-b93bf9f7d5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0faf248-95a2-48ea-846c-2dd8b34cf9f6', 'volume_name': 'volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103865cd-0aa9-4357-b908-a6796bdca38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103865cd-0aa9-4357-b908-a6796bdca38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d710b984-dc74-4adb-beea-76a8be558aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume b0faf248-95a2-48ea-846c-2dd8b34cf9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6', 'volume_size': 1} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (fc72733b-2321-4be1-af5a-fdd346ea338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750c5fc9-a28f-4930-91cf-30b2e56860dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750c5fc9-a28f-4930-91cf-30b2e56860dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-165360457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2575dcbe-4b9a-4b3b-8798-28a1d56a23af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc12965ec2b487795f9e8da8d24bc37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=18ca219b-292d-4a13-818c-0c9505bffc20,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:59Z,use_quota=True,user_id='280600000b2c4653a546b0964a92a8fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186fd41a-dde8-4afa-ae14-70c0da80e86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186fd41a-dde8-4afa-ae14-70c0da80e86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84749970-c6c7-4e37-afcc-aa3ed0a978a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84749970-c6c7-4e37-afcc-aa3ed0a978a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2575dcbe-4b9a-4b3b-8798-28a1d56a23af', 'volume_name': 'volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af', 'volume_size': 1, 'source_volid': '18ca219b-292d-4a13-818c-0c9505bffc20', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97aa276-6cb5-4975-9d13-e2529c8eb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97aa276-6cb5-4975-9d13-e2529c8eb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0caf912-42f2-4fff-bb33-da00ae777e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:17:59 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Volume 2575dcbe-4b9a-4b3b-8798-28a1d56a23af: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af', 'volume_size': 1, 'source_volid': '18ca219b-292d-4a13-818c-0c9505bffc20', 'source_volstatus': 'available'} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:17:59 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.752s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:17:59 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:17:59 devstack sudo[93752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 Apr 30 11:17:59 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:04 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28" returned: 0 in 4.704s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:04 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f136e2be-85b7-48ac-b841-254b454a8cb2]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:04 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:04 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:18:04 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:05 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.910s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:18:05 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Converted 1024.00 MB image at 217.61 MB/s Apr 30 11:18:05 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 is being set with open permissions: ugo+rw Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:05 devstack sudo[93770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 Apr 30 11:18:05 devstack sudo[93770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:05 devstack sudo[93770]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28" returned: 0 in 0.605s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" released by "_copy_volume_from_snapshot" :: held 7.978s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285-e6af6c3a-0f17-473c-af71-07fcb88a2b28" released by "_create_volume_from_snapshot" :: held 8.044s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.078s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.249s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000467256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d83ba22-fab2-463e-b43c-06a51130cecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:57Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume 4d83ba22-fab2-463e-b43c-06a51130cecc {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:05 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=133,cinder:UPDATE=145,cinder:INSERT=28,cinder:DELETE=11 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:18:05 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc 1073741824 Apr 30 11:18:05 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:SELECT=104,cinder:UPDATE=170,cinder:INSERT=42,cinder:DELETE=20 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62ebda7-6d60-4b29-9873-218958bfd11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28', 'volume_size': 1, 'snapshot_id': '285c6bf5-6dad-4c8c-93c8-aefe73d65285'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a66e30-e2dd-4b59-9d5e-74b835d26d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:05 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Volume volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 (e6af6c3a-0f17-473c-af71-07fcb88a2b28): created successfully Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a66e30-e2dd-4b59-9d5e-74b835d26d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:05 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Flow 'volume_create_manager' (75efbcc8-c461-4148-a0eb-34abff603878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:05 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f80468c2-f923-4a29-a394-92e31d05b173 tempest-SnapshotDependencyTests-1750591080 None] Created volume successfully. Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-285c6bf5-6dad-4c8c-93c8-aefe73d65285-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-285c6bf5-6dad-4c8c-93c8-aefe73d65285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Deleting offline snapshot 285c6bf5-6dad-4c8c-93c8-aefe73d65285 of volume 57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] snapshot_file for this snap is: volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0339d3d6-871a-406d-a121-a20b7700222e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:06 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:18:06 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:06 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc 1073741824" returned: 0 in 0.805s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:06 devstack sudo[93781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc Apr 30 11:18:06 devstack sudo[93781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:07 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:07 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:07 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.744s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[da77eb2b-3b76-4631-9994-16da5bf7c25d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:07 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:18:07 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:07 devstack sudo[93781]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc" returned: 0 in 0.628s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.307s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-153697258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=069eb78d-3d21-4b7a-89f6-a09dd446dad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:58Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume 069eb78d-3d21-4b7a-89f6-a09dd446dad4 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:07 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4695a706-e798-402f-b101-a950790507ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d83ba22-fab2-463e-b43c-06a51130cecc', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c782c9a-a46b-4c15-bb2f-2797010e053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:07 devstack sudo[93791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 1073741824 Apr 30 11:18:07 devstack sudo[93791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:07 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-4d83ba22-fab2-463e-b43c-06a51130cecc (4d83ba22-fab2-463e-b43c-06a51130cecc): created successfully Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c782c9a-a46b-4c15-bb2f-2797010e053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (4e5c34d9-6cdc-4e1d-9dd7-743c57dbbf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:07 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-568b7b7a-ee74-4b7a-82a1-10bc9b13ca1c tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:18:07 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.619s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:07 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.736s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:07 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:18:07 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:08 devstack sudo[93791]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 1073741824" returned: 0 in 0.784s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:08 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 Apr 30 11:18:08 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:08 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.712s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:08 devstack sudo[93807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285 Apr 30 11:18:08 devstack sudo[93807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:08 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4" returned: 0 in 0.597s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.375s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1233160611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71177078-ac97-4352-b001-791e4c0cc088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:58Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume 71177078-ac97-4352-b001-791e4c0cc088 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:08 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e668b6-fb29-4b28-ac47-afc9025fbf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:08 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 1073741824 Apr 30 11:18:08 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff5194-0594-4aec-bfaf-d3c2a1417876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:08 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 (069eb78d-3d21-4b7a-89f6-a09dd446dad4): created successfully Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43ff5194-0594-4aec-bfaf-d3c2a1417876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:08 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (c7aeaa8a-d5af-4a3c-b983-122721f4aecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:08 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-16a4845e-f312-47b8-91da-d26ad59a2b0a tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:18:09 devstack sudo[93807]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa.285c6bf5-6dad-4c8c-93c8-aefe73d65285" returned: 0 in 0.612s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-285c6bf5-6dad-4c8c-93c8-aefe73d65285" released by "_delete_snapshot" :: held 2.909s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" released by "delete_snapshot" :: held 2.931s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Created reservations ['09273e2d-c9c9-4d84-9cf4-528b353103e3', 'f278ba71-0069-4deb-8367-ba3ca5354322', 'e2aa66ed-9d39-4696-bdde-a07acd3786a8', '37d75c82-607b-4ee6-8326-af69427b5e1e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:09 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Delete snapshot completed successfully. Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-03037534-bd37-4fb2-9e58-5479e74b7dfe tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-285c6bf5-6dad-4c8c-93c8-aefe73d65285-delete_snapshot" released by "delete_snapshot" :: held 3.066s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-57206ec9-81f9-4566-bf94-131ad9dbb4fa-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-57206ec9-81f9-4566-bf94-131ad9dbb4fa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84b8900-c902-45e4-a3e0-20464966482f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:09 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 1073741824" returned: 0 in 0.845s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:09 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:09 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:18:09 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:09 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 Apr 30 11:18:09 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:10 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088" returned: 0 in 0.595s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.497s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-599492293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c9d127-8d34-40e2-bf09-06768c8ce019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:59Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume 57c9d127-8d34-40e2-bf09-06768c8ce019 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:10 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7250c6e-1cba-46fa-b1c4-21856cb2f9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71177078-ac97-4352-b001-791e4c0cc088', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:10 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 1073741824 Apr 30 11:18:10 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23459e94-198c-42a5-9c3a-a8932b855552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:10 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:10 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-71177078-ac97-4352-b001-791e4c0cc088 (71177078-ac97-4352-b001-791e4c0cc088): created successfully Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23459e94-198c-42a5-9c3a-a8932b855552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (2da6924b-0cfa-4fe3-812f-9fd841a0c337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.753s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:10 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-362337a6-ea26-4d13-b05c-34f906ce38df tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:18:10 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa Apr 30 11:18:10 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:10 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57206ec9-81f9-4566-bf94-131ad9dbb4fa" returned: 0 in 0.633s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:10 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-57206ec9-81f9-4566-bf94-131ad9dbb4fa" released by "delete_volume" :: held 1.455s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Created reservations ['c79a9beb-47ad-40fb-9aea-8f1587c51351', 'ac7d0a9c-74b2-4495-8409-b5b0d47ac76b', 'b6161c95-8499-4f96-bb98-b96b21bfe3d1', 'e75f44fd-ab90-44e3-9ed3-0f7074fcfaeb'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:11 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 1073741824" returned: 0 in 0.837s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:11 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:11 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:11 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 Apr 30 11:18:11 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:11 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-e6af6c3a-0f17-473c-af71-07fcb88a2b28-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.605s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Deleted volume successfully. Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-e6af6c3a-0f17-473c-af71-07fcb88a2b28-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:11 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019" returned: 0 in 0.603s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.587s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-602411791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0faf248-95a2-48ea-846c-2dd8b34cf9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d49c556234d4cd7b74bab5a8b91f0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:17:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:17:59Z,use_quota=True,user_id='28d42e771e8447969cd2043303b8865a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Creating volume b0faf248-95a2-48ea-846c-2dd8b34cf9f6 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:11 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (666d9ee2-97d4-459b-85d4-af01a81acda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c9d127-8d34-40e2-bf09-06768c8ce019', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:11 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 1073741824 Apr 30 11:18:11 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7070acc1-8e75-4c5c-921a-b5658ab3cb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-fc793a60-ecad-422d-8129-7dcc7fbc6a5a tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-57206ec9-81f9-4566-bf94-131ad9dbb4fa-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:11 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-57c9d127-8d34-40e2-bf09-06768c8ce019 (57c9d127-8d34-40e2-bf09-06768c8ce019): created successfully Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7070acc1-8e75-4c5c-921a-b5658ab3cb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (e2dc0e18-84cf-4ec1-bebd-79f3ec9c102c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:11 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-18802eba-401c-4b17-b741-c0b8afc5a2b7 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" acquired by "delete_volume" :: waited 0.019s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9452660-ef78-4704-937d-f18fbf59dfab]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:11 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:11 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 Apr 30 11:18:11 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:12 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 1073741824" returned: 0 in 0.798s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:12 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 Apr 30 11:18:12 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:12 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28" returned: 0 in 0.755s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:12 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:12 devstack sudo[93853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28 Apr 30 11:18:12 devstack sudo[93853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:13 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" returned: 0 in 0.596s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.914s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:13 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Cloning volume 18ca219b-292d-4a13-818c-0c9505bffc20 to volume 2575dcbe-4b9a-4b3b-8798-28a1d56a23af Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d710b984-dc74-4adb-beea-76a8be558aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd0a409-d92f-43cd-b39e-7b9725750984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:13 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Volume volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 (b0faf248-95a2-48ea-846c-2dd8b34cf9f6): created successfully Apr 30 11:18:13 devstack sudo[93853]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd0a409-d92f-43cd-b39e-7b9725750984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Flow 'volume_create_manager' (aeb5ab37-0dce-4527-b335-80715edc788d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Creating offline snapshot 4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 of volume 18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-e6af6c3a-0f17-473c-af71-07fcb88a2b28" returned: 0 in 0.633s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-quobyte-e6af6c3a-0f17-473c-af71-07fcb88a2b28" released by "delete_volume" :: held 1.432s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:13 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b9fe576a-a665-436c-b97a-3994a12ee1ab tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created volume successfully. Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[347b84ed-b7b5-483c-ab56-e00cf7bd1dda]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Created reservations ['accc0b06-3656-432c-b0b6-d62a9f9af524', '10f4eba5-aafb-4c05-88ca-56286b6f516d', '2540d969-28a2-4fbf-91a9-146aa7465ad8', 'b3450242-2001-4968-960e-99867ae140c2'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:13 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:13 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:13 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:13 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:13 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:13 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.604s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:14 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Deleted volume successfully. Apr 30 11:18:14 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.751s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-7783a30d-3519-4e8a-89e7-052d1c558de1 tempest-SnapshotDependencyTests-1750591080 None] Lock "cinder-e6af6c3a-0f17-473c-af71-07fcb88a2b28-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:14 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 1G Apr 30 11:18:14 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-b0faf248-95a2-48ea-846c-2dd8b34cf9f6-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-b0faf248-95a2-48ea-846c-2dd8b34cf9f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7b1479-be00-492b-ac1f-17c1c83e469d]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:14 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 Apr 30 11:18:14 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:14 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 1G" returned: 0 in 0.871s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:14 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ca219b-292d-4a13-818c-0c9505bffc20 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:14 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ca219b-292d-4a13-818c-0c9505bffc20 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:14 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:15 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" returned: 0 in 0.841s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:15 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6 Apr 30 11:18:15 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:15 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18ca219b-292d-4a13-818c-0c9505bffc20 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.756s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:15 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 is being set with open permissions: ugo+rw Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:15 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:15 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:15 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" returned: 0 in 0.676s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:15 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-b0faf248-95a2-48ea-846c-2dd8b34cf9f6" released by "delete_volume" :: held 1.570s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['ce23a8d6-3f66-4df6-9c7c-51ea735499b5', 'a3d21e32-6c2b-49c9-951d-0b364e45e7ab', 'e427a18e-3725-472d-863b-b065a977abac', '7fefce87-f1b6-4365-9ca3-1c79ccf3adc2'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:16 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:16 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:16 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.635s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:16 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info Apr 30 11:18:16 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-57c9d127-8d34-40e2-bf09-06768c8ce019-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-57c9d127-8d34-40e2-bf09-06768c8ce019-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-57c9d127-8d34-40e2-bf09-06768c8ce019" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-57c9d127-8d34-40e2-bf09-06768c8ce019" acquired by "delete_volume" :: waited 0.027s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff22ea0c-22b9-4e8d-b43a-50faba53b9cf]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:16 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.712s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:16 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:16 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 Apr 30 11:18:16 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:16 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-2d0b9a96-66de-462c-b8e0-c576717df119 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-b0faf248-95a2-48ea-846c-2dd8b34cf9f6-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:17 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info" returned: 0 in 0.887s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:17 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info is being set with open permissions: ugo+rw Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:17 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info Apr 30 11:18:17 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:17 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019" returned: 0 in 0.856s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:17 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019 Apr 30 11:18:17 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:17 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.info" returned: 0 in 0.694s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" by "_copy_volume_from_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] snapshot: 4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8, volume: 2575dcbe-4b9a-4b3b-8798-28a1d56a23af, {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:17 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3b337a-796f-42ca-8ae9-b4b609f5e407]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:18 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:18 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:18 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-57c9d127-8d34-40e2-bf09-06768c8ce019" returned: 0 in 0.673s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-57c9d127-8d34-40e2-bf09-06768c8ce019" released by "delete_volume" :: held 1.581s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['2a9af64a-a6c4-411d-9dff-4bb24909681d', '0cc18a22-a683-4382-869a-641703da0eb8', '50c53267-0223-4418-9da0-bd7e7781d7bb', 'a429bf15-7c63-4d10-9f00-1d7ef36dd460'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:18 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:18 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:18 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.806s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ca219b-292d-4a13-818c-0c9505bffc20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Creating direct copy from snapshot {{(pid=84206) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[4988d17a-3c35-4418-b42b-107d720e5f97]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-71177078-ac97-4352-b001-791e4c0cc088-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-71177078-ac97-4352-b001-791e4c0cc088-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:18 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-71177078-ac97-4352-b001-791e4c0cc088" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-71177078-ac97-4352-b001-791e4c0cc088" acquired by "delete_volume" :: waited 0.026s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bb2c00-777e-4836-8f52-bcad04f26133]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:19 devstack sudo[93914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:19 devstack sudo[93914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:19 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.662s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:19 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-cc7c797a-2506-421f-a933-5fbe9b841e18 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-57c9d127-8d34-40e2-bf09-06768c8ce019-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:19 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 Apr 30 11:18:19 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:19 devstack sudo[93914]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.910s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG cinder.utils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Path /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af not found in is_blk_device check {{(pid=84206) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:19 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af Apr 30 11:18:19 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:19 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088" returned: 0 in 0.834s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:19 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:19 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088 Apr 30 11:18:19 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:20 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-71177078-ac97-4352-b001-791e4c0cc088" returned: 0 in 0.680s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-71177078-ac97-4352-b001-791e4c0cc088" released by "delete_volume" :: held 1.591s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['1c68ac19-613b-4769-aa84-17dd9936d9b7', 'f5f0c531-1e70-4a45-926a-9c71316a6733', '0e0dfe4d-3e64-47cd-a37b-117ab37fbf41', 'baef80db-3e21-4cb5-8b87-f4960e499425'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:20 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:21 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:21 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-069eb78d-3d21-4b7a-89f6-a09dd446dad4-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-069eb78d-3d21-4b7a-89f6-a09dd446dad4-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-069eb78d-3d21-4b7a-89f6-a09dd446dad4" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-069eb78d-3d21-4b7a-89f6-a09dd446dad4" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b19552d-ac7c-407c-9aa1-cbdb61c504af]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:21 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:21 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 Apr 30 11:18:21 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:22 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:22 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.719s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:22 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:22 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:22 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ea1f22cf-0958-425f-a71d-1e4be9a4f6f3 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-71177078-ac97-4352-b001-791e4c0cc088-delete_volume" released by "delete_volume" :: held 3.849s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:23 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4" returned: 0 in 1.640s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:23 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:23 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4 Apr 30 11:18:23 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:24 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:24 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-069eb78d-3d21-4b7a-89f6-a09dd446dad4" returned: 0 in 1.361s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:24 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-069eb78d-3d21-4b7a-89f6-a09dd446dad4" released by "delete_volume" :: held 3.101s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:24 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['6e4e034c-f873-42c6-8a97-ba56b3ede95c', '65d8de57-f7ea-4ce7-9f56-4ea013c2ef21', 'b7e99157-9a92-400c-bafe-5fbb368d5ac9', '42f98dc4-f2ad-4bb2-b9e3-2ce2f00c14a1'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-4d83ba22-fab2-463e-b43c-06a51130cecc-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:25 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:25 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-4d83ba22-fab2-463e-b43c-06a51130cecc-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-4d83ba22-fab2-463e-b43c-06a51130cecc" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-4d83ba22-fab2-463e-b43c-06a51130cecc" acquired by "delete_volume" :: waited 0.049s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f7cbf7-95b1-40ff-96f4-937d82fc3814]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:25 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:25 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc Apr 30 11:18:25 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:26 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" returned: 0 in 6.532s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0047ca-4e4d-44d7-b478-3c9bd8276408]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:26 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 1.369s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:26 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:26 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:26 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-84bce930-7523-45e7-a468-4d7ef692003e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-069eb78d-3d21-4b7a-89f6-a09dd446dad4-delete_volume" released by "delete_volume" :: held 5.106s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:26 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc" returned: 0 in 1.216s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:26 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:26 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc Apr 30 11:18:26 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:27 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-4d83ba22-fab2-463e-b43c-06a51130cecc" returned: 0 in 0.677s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:27 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 1.068s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.image.image_utils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Image conversion details: src /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af {{(pid=84206) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 30 11:18:27 devstack cinder-volume[84206]: INFO cinder.image.image_utils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Converted 1024.00 MB image at 156.69 MB/s Apr 30 11:18:27 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af is being set with open permissions: ugo+rw Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-4d83ba22-fab2-463e-b43c-06a51130cecc" released by "delete_volume" :: held 2.003s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:27 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af Apr 30 11:18:27 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['374615d4-14aa-4fae-878f-f6e113299d68', '09a8ed1b-f8c4-4804-92ec-09bf3c9b3db0', '3d111d9d-7269-4cc3-bae1-e7485425ed0c', 'ff77288d-8207-468b-ba3f-e5b2182b8c41'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:27 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:27 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-0ad20c99-c23b-4500-bf89-e96125941e79-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-0ad20c99-c23b-4500-bf89-e96125941e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-0ad20c99-c23b-4500-bf89-e96125941e79" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-0ad20c99-c23b-4500-bf89-e96125941e79" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleting offline snapshot 0ad20c99-c23b-4500-bf89-e96125941e79 of volume 651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] snapshot_file for this snap is: volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aede654-0903-4d45-9872-34709870241a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:27 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:27 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 Apr 30 11:18:27 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:28 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" returned: 0 in 0.683s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" released by "_copy_volume_from_snapshot" :: held 10.119s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Deleting offline snapshot 4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 of volume 18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] snapshot_file for this snap is: volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11acc7e-dec6-4c0a-b1d8-d24dc5dc3c9a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:28 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.675s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:28 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:28 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:28 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-c416c439-d836-4f99-b783-3facba50a207 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-4d83ba22-fab2-463e-b43c-06a51130cecc-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:28 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79" returned: 0 in 0.720s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a30a23-735f-4ea9-977e-ff806460f46a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:28 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 Apr 30 11:18:28 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:28 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.791s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18ca219b-292d-4a13-818c-0c9505bffc20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[26939aa5-1836-470e-afea-d6786d1d4f0e]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:28 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:29 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:29 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:29 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2" returned: 0 in 0.790s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:29 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 Apr 30 11:18:29 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:29 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.812s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:29 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:29 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:29 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79" returned: 0 in 0.723s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:29 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:30 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79 Apr 30 11:18:30 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:30 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.751s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:30 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8 Apr 30 11:18:30 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:30 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2.0ad20c99-c23b-4500-bf89-e96125941e79" returned: 0 in 0.685s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-0ad20c99-c23b-4500-bf89-e96125941e79" released by "_delete_snapshot" :: held 3.041s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" released by "delete_snapshot" :: held 3.073s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['9bdf1d5f-fb63-44b4-9dc0-e98973f7dd68', '68804814-7274-4482-8fad-f676f6b0a8db', '5a38b843-df16-4aca-bc72-a2e1eae2605c', 'e47c8e3d-b0aa-4af8-bf5d-8650e7f55e9e'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:30 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Delete snapshot completed successfully. Apr 30 11:18:30 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-68df8b11-35ae-402f-96b3-2666bd5d1b8e tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-0ad20c99-c23b-4500-bf89-e96125941e79-delete_snapshot" released by "delete_snapshot" :: held 3.213s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:31 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20.4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" returned: 0 in 0.671s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-4fe8b2ac-7c11-4ee4-ad86-3dacc0cae5a8" released by "_delete_snapshot" :: held 3.113s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.097s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0caf912-42f2-4fff-bb33-da00ae777e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af', 'volume_size': 1, 'source_volid': '18ca219b-292d-4a13-818c-0c9505bffc20', 'source_volstatus': 'available'}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7413b2-b1ed-4b93-85b7-0d0ea67d530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:31 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Volume volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af (2575dcbe-4b9a-4b3b-8798-28a1d56a23af): created successfully Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7413b2-b1ed-4b93-85b7-0d0ea67d530b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Flow 'volume_create_manager' (fc72733b-2321-4be1-af5a-fdd346ea338a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:31 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-a03d88c8-007e-4852-ba34-91317bff7ad1 tempest-VolumeDependencyTests-1184143737 None] Created volume successfully. Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-651d4c4a-c4cd-4495-96c7-69509d5f52b2-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-651d4c4a-c4cd-4495-96c7-69509d5f52b2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-18ca219b-292d-4a13-818c-0c9505bffc20-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" acquired by "delete_volume" :: waited 0.028s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-18ca219b-292d-4a13-818c-0c9505bffc20-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f2af67-1f2c-475d-8b40-fa5ceadb2f52]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:31 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-18ca219b-292d-4a13-818c-0c9505bffc20" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-18ca219b-292d-4a13-818c-0c9505bffc20" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1732ed1-b92b-4a55-a33d-7fc70fcc26d1]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:32 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 Apr 30 11:18:32 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:32 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:32 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:32 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2" returned: 0 in 0.820s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:32 devstack sudo[94024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2 Apr 30 11:18:32 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:32 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:32 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:32 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20 Apr 30 11:18:32 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:33 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-651d4c4a-c4cd-4495-96c7-69509d5f52b2" returned: 0 in 0.697s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-quobyte-651d4c4a-c4cd-4495-96c7-69509d5f52b2" released by "delete_volume" :: held 1.603s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:33 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-18ca219b-292d-4a13-818c-0c9505bffc20" returned: 0 in 0.668s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-18ca219b-292d-4a13-818c-0c9505bffc20" released by "delete_volume" :: held 1.533s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Created reservations ['096408e8-d79f-4bbd-88d2-6fdc4ffe2ebd', '7f79b23c-8490-4c23-94ef-b8f60b0b9ef8', '9c2c43d1-f612-4e51-9dfd-f2217ce01b60', '37e7e752-6dd3-4313-acdd-48af18f234a5'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Created reservations ['8a560da2-854d-4d15-aac2-438fb8a9e07a', '2fad0a8d-b0fb-41b7-a96b-8aec4bf1ad8a', 'c706ebb0-f17b-44d3-ad39-4339000df02f', '455e39d9-8ac6-4a1d-bfa1-b07781cbcdbc'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:33 devstack sudo[94030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:33 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:33 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:33 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:33 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-2575dcbe-4b9a-4b3b-8798-28a1d56a23af-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-2575dcbe-4b9a-4b3b-8798-28a1d56a23af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" acquired by "delete_volume" :: waited 0.024s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b401645-58c5-4649-a9b1-0c0891d96b09]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:34 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af Apr 30 11:18:34 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:34 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.773s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Deleted volume successfully. Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-f020b7e1-2259-4978-b9b7-5a9974866d45 tempest-CreateVolumesFromSnapshotTest-1599565411 None] Lock "cinder-651d4c4a-c4cd-4495-96c7-69509d5f52b2-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:34 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.765s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:34 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Deleted volume successfully. Apr 30 11:18:34 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-1f5fffc4-11a1-43bb-939d-b458f2000c94 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-18ca219b-292d-4a13-818c-0c9505bffc20-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:35 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" returned: 0 in 0.802s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:35 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af Apr 30 11:18:35 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:35 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" returned: 0 in 0.628s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-2575dcbe-4b9a-4b3b-8798-28a1d56a23af" released by "delete_volume" :: held 1.488s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Created reservations ['bd9c0432-f338-4bee-9f7d-424bb6849ced', '98f116c9-fe0a-442c-9811-a065760c54f3', '9176d283-c647-45e3-989f-291f610d391e', 'c842a9db-e752-469e-a814-e9ade0462a90'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:35 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:35 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:35 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-5e5bbce3-719b-47f6-a6e3-019788867085-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:36 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.618s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:36 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Deleted volume successfully. Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-5e5bbce3-719b-47f6-a6e3-019788867085-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b90e4e89-6ee6-437c-8583-5b7a995b588e tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-2575dcbe-4b9a-4b3b-8798-28a1d56a23af-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c5edb0-5cb6-4fb6-addc-8b0366b46154]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:36 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:36 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 Apr 30 11:18:36 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Flow 'volume_create_manager' (f48ef185-1c3f-47f8-b75a-2091538b0f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a628b006-7c0c-464b-8569-ab48cff6d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a628b006-7c0c-464b-8569-ab48cff6d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ec442-3bb6-466f-b61b-2eda5c00e156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3019df8b054a89aa2abc42e51adeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:18:37Z,use_quota=True,user_id='7133ac4db8ff461da38e38f2423c1e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5aca67-dfc5-4c8a-83d1-59eaa64b0550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee5aca67-dfc5-4c8a-83d1-59eaa64b0550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f786a0f-e156-449d-b695-6733c1ba371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f786a0f-e156-449d-b695-6733c1ba371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c1ec442-3bb6-466f-b61b-2eda5c00e156', 'volume_name': 'volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216fc711-d38a-425a-a061-5744fd70bc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216fc711-d38a-425a-a061-5744fd70bc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4c7064-d214-48e1-b675-6b74a39d18d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:37 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Volume 0c1ec442-3bb6-466f-b61b-2eda5c00e156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156', 'volume_size': 1} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c1ec442-3bb6-466f-b61b-2eda5c00e156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3019df8b054a89aa2abc42e51adeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:18:37Z,use_quota=True,user_id='7133ac4db8ff461da38e38f2423c1e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Creating volume 0c1ec442-3bb6-466f-b61b-2eda5c00e156 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:37 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:37 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 1073741824 Apr 30 11:18:37 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:37 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085" returned: 0 in 0.734s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:37 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085 Apr 30 11:18:37 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:37 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-5e5bbce3-719b-47f6-a6e3-019788867085" returned: 0 in 0.597s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:37 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-quobyte-5e5bbce3-719b-47f6-a6e3-019788867085" released by "delete_volume" :: held 1.383s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Created reservations ['105ef979-b6ba-447a-b89d-ef8059968d5e', 'f0fe315f-6d54-401e-8227-f219c60c1f3d', '732ad775-4773-4c55-9c54-58505434c4b3', 'f8693f08-e12b-49f1-97a7-474ae2939315'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:38 devstack sudo[94060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:38 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:38 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 1073741824" returned: 0 in 0.926s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:38 devstack sudo[94062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 Apr 30 11:18:38 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:38 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.597s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:38 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Deleted volume successfully. Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-672596e4-e114-46ad-aacc-53a7ca409f19 tempest-VolumeDependencyTests-1184143737 None] Lock "cinder-5e5bbce3-719b-47f6-a6e3-019788867085-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:38 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156" returned: 0 in 0.642s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a4c7064-d214-48e1-b675-6b74a39d18d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e02cdc-62ea-44f9-9502-e27986e9ad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:38 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Volume volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 (0c1ec442-3bb6-466f-b61b-2eda5c00e156): created successfully Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e02cdc-62ea-44f9-9502-e27986e9ad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:38 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Flow 'volume_create_manager' (f48ef185-1c3f-47f8-b75a-2091538b0f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:39 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-14c1bffb-0e2a-4e91-8a8f-b18bdc262599 tempest-CinderUnicodeTest-246824305 None] Created volume successfully. Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.flows.manager.create_volume [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84206) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Flow 'volume_create_manager' (bd33a834-3c19-4c0a-bf67-587236257f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73b4065-f4b5-4f0a-9d3a-df527a0e3957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73b4065-f4b5-4f0a-9d3a-df527a0e3957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:18:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1216593554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2097d75-a6c9-4c8e-b863-ad5196533425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3019df8b054a89aa2abc42e51adeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:18:40Z,use_quota=True,user_id='7133ac4db8ff461da38e38f2423c1e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02a4337-13b4-4a21-b51f-67f67d1f3101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02a4337-13b4-4a21-b51f-67f67d1f3101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a006934-1e51-4ba8-bf94-19a02ee7e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a006934-1e51-4ba8-bf94-19a02ee7e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2097d75-a6c9-4c8e-b863-ad5196533425', 'volume_name': 'volume-c2097d75-a6c9-4c8e-b863-ad5196533425', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd48bc-a5bb-4df0-bcb8-d410376b2032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd48bc-a5bb-4df0-bcb8-d410376b2032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2fa03-d3e1-451f-8d40-7b40a235f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:39 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Volume c2097d75-a6c9-4c8e-b863-ad5196533425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2097d75-a6c9-4c8e-b863-ad5196533425', 'volume_size': 1} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-30T09:18:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1216593554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2097d75-a6c9-4c8e-b863-ad5196533425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc3019df8b054a89aa2abc42e51adeb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-30T09:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-30T09:18:40Z,use_quota=True,user_id='7133ac4db8ff461da38e38f2423c1e78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8531684e-13e2-411e-9985-e8992e48d150),volume_type_id=8531684e-13e2-411e-9985-e8992e48d150)}" {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Creating volume c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Selected osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 as target Quobyte volume. {{(pid=84206) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 30 11:18:39 devstack cinder-volume[84206]: INFO cinder.volume.drivers.remotefs [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] casted to osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085 Apr 30 11:18:39 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 1073741824 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:40 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 1073741824 Apr 30 11:18:40 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:40 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 1073741824" returned: 0 in 0.882s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:40 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:40 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 Apr 30 11:18:40 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:41 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425" returned: 0 in 0.667s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'} {{(pid=84206) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed2fa03-d3e1-451f-8d40-7b40a235f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2097d75-a6c9-4c8e-b863-ad5196533425', 'volume_size': 1}' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cc4b5b-1bdf-4ea9-aa30-473efcd8d928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 30 11:18:41 devstack cinder-volume[84206]: INFO cinder.volume.flows.manager.create_volume [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Volume volume-c2097d75-a6c9-4c8e-b863-ad5196533425 (c2097d75-a6c9-4c8e-b863-ad5196533425): created successfully Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77cc4b5b-1bdf-4ea9-aa30-473efcd8d928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84206) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 30 11:18:41 devstack cinder-volume[84206]: DEBUG cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Flow 'volume_create_manager' (bd33a834-3c19-4c0a-bf67-587236257f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84206) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 30 11:18:41 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-8401d33f-7921-43e7-bb32-dd22feb7c2c9 tempest-CinderUnicodeTest-246824305 None] Created volume successfully. Apr 30 11:18:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:42 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Creating offline snapshot 57d8937c-7cc2-4abb-99c2-41ba039de0b6 of volume c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 30 11:18:42 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98acbe6-8f99-46b7-9164-a968da406b07]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:42 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:42 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 Apr 30 11:18:42 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:43 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425" returned: 0 in 0.749s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 1G {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:43 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 1G Apr 30 11:18:43 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:43 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 1G" returned: 0 in 0.777s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:43 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2097d75-a6c9-4c8e-b863-ad5196533425 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:43 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2097d75-a6c9-4c8e-b863-ad5196533425 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 Apr 30 11:18:43 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:44 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2097d75-a6c9-4c8e-b863-ad5196533425 -F qcow2 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6" returned: 0 in 0.633s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:44 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 is being set with open permissions: ugo+rw Apr 30 11:18:44 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:44 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 Apr 30 11:18:44 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:45 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6" returned: 0 in 0.607s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:45 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info Apr 30 11:18:45 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:45 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info" returned: 0 in 0.616s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:45 devstack cinder-volume[84206]: WARNING cinder.volume.drivers.remotefs [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info is being set with open permissions: ugo+rw Apr 30 11:18:45 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:45 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info Apr 30 11:18:45 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:46 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.info" returned: 0 in 0.615s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.079s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:46 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-1555dc7b-0300-4a1a-ba6d-511fd8fc511b tempest-CinderUnicodeTest-246824305 None] Create snapshot completed successfully Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-57d8937c-7cc2-4abb-99c2-41ba039de0b6-delete_snapshot" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-57d8937c-7cc2-4abb-99c2-41ba039de0b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" by "delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-quobyte-57d8937c-7cc2-4abb-99c2-41ba039de0b6" by "_delete_snapshot" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-57d8937c-7cc2-4abb-99c2-41ba039de0b6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Deleting offline snapshot 57d8937c-7cc2-4abb-99c2-41ba039de0b6 of volume c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] snapshot_file for this snap is: volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[74552af9-92a3-4def-9644-e78b90a9e40f]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:46 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:46 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 Apr 30 11:18:46 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:47 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6" returned: 0 in 0.760s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:47 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.remotefs [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2097d75-a6c9-4c8e-b863-ad5196533425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84206) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 30 11:18:47 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55fda3-dc86-4f21-8efe-43c59ad394c8]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:47 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:47 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 Apr 30 11:18:47 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:48 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425" returned: 0 in 0.783s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:48 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 Apr 30 11:18:48 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:48 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6" returned: 0 in 0.705s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:48 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:48 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6 Apr 30 11:18:48 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:49 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425.57d8937c-7cc2-4abb-99c2-41ba039de0b6" returned: 0 in 0.588s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-57d8937c-7cc2-4abb-99c2-41ba039de0b6" released by "_delete_snapshot" :: held 2.934s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" released by "delete_snapshot" :: held 2.956s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Created reservations ['45f06fa4-69e1-49ae-896a-a18e3b4e6f74', 'c16f3630-8d0a-4688-b65b-481764636839', 'ec06c0de-cce3-443a-836e-2b2dcbdd58e1', 'cfb51f79-1f02-4bf0-baf8-3c9019b76702'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:49 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Delete snapshot completed successfully. Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-b998c92b-2937-4ff0-9113-274a69c27d79 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-57d8937c-7cc2-4abb-99c2-41ba039de0b6-delete_snapshot" released by "delete_snapshot" :: held 3.082s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-c2097d75-a6c9-4c8e-b863-ad5196533425-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-c2097d75-a6c9-4c8e-b863-ad5196533425-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41a2cdb-321a-403c-a2d1-cb4cdcd5701a]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:49 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:49 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 Apr 30 11:18:49 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:50 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425" returned: 0 in 0.714s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:50 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:50 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425 Apr 30 11:18:50 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:51 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-c2097d75-a6c9-4c8e-b863-ad5196533425" returned: 0 in 0.637s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-c2097d75-a6c9-4c8e-b863-ad5196533425" released by "delete_volume" :: held 1.411s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Created reservations ['803b8c5f-1923-4e04-91d0-7db1372e85f5', '92a19345-e7ef-4d2d-be61-ef73e30a1e8c', 'db5bee18-1864-4b05-b150-f65a0588052b', 'c1ac212f-0763-4492-a068-b3be43854c8d'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:51 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:51 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:51 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.606s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:51 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Deleted volume successfully. Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-90cb1f8a-1b04-4857-aa89-521efb83c896 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-c2097d75-a6c9-4c8e-b863-ad5196533425-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-0c1ec442-3bb6-466f-b61b-2eda5c00e156-delete_volume" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-0c1ec442-3bb6-466f-b61b-2eda5c00e156-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "cinder-quobyte-0c1ec442-3bb6-466f-b61b-2eda5c00e156" by "delete_volume" {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-0c1ec442-3bb6-466f-b61b-2eda5c00e156" acquired by "delete_volume" :: waited 0.013s {{(pid=84206) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo.privsep.daemon [-] privsep: reply[835671ba-ef99-4874-9a8a-1c743ca49588]: (4, 'qcow2') {{(pid=85171) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 30 11:18:51 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:52 devstack sudo[94167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 Apr 30 11:18:52 devstack sudo[94167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:52 devstack sudo[94167]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156" returned: 0 in 0.694s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:52 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:52 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156 Apr 30 11:18:52 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:53 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d/volume-0c1ec442-3bb6-466f-b61b-2eda5c00e156" returned: 0 in 0.640s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-quobyte-0c1ec442-3bb6-466f-b61b-2eda5c00e156" released by "delete_volume" :: held 1.377s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG cinder.quota [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Created reservations ['fc326d49-09fd-42e4-b79d-662491478451', 'be55f153-e4b6-4a42-8c16-5ac95a2dfa2e', 'b2201f4d-614a-4577-9960-59b5806b0bb1', '611b5197-93a5-4d9d-a8c3-fbd389b6329c'] {{(pid=84206) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:18:53 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:18:53 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:18:53 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:18:54 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Apr 30 11:18:54 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.625s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:18:54 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 30 11:18:54 devstack cinder-volume[84206]: INFO cinder.volume.manager [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Deleted volume successfully. Apr 30 11:18:54 devstack cinder-volume[84206]: DEBUG cinder.coordination [None req-ccea1b32-d7fa-4187-895b-b3fb5c0d9d13 tempest-CinderUnicodeTest-246824305 None] Lock "cinder-0c1ec442-3bb6-466f-b61b-2eda5c00e156-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=84206) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 30 11:19:03 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:DELETE=12,cinder:SELECT=95,cinder:INSERT=35,cinder:UPDATE=149 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:04 devstack cinder-volume[84206]: DEBUG dbcounter [-] [84206] Writing DB stats cinder:UPDATE=142,cinder:SELECT=99,cinder:DELETE=11,cinder:INSERT=40 {{(pid=84206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG oslo_service.periodic_task [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085': None} {{(pid=84206) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG cinder.volume.drivers.quobyte [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e1f7ea7e-7447-48d5-9c87-6cdbb10f9085'] {{(pid=84206) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.lockutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84206) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 30 11:19:06 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 30 11:19:07 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d Apr 30 11:19:07 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 30 11:19:07 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Apr 30 11:19:07 devstack cinder-volume[84206]: DEBUG oslo_concurrency.processutils [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0f94ddf1a1dcc1fca1d63cf57bee2a6d" returned: 0 in 0.671s {{(pid=84206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 30 11:19:07 devstack cinder-volume[84206]: DEBUG cinder.manager [None req-ad34c153-239e-4a90-a48e-717552a286ed None None] Notifying Schedulers of capabilities ... {{(pid=84206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}